Nov 05 18:26:47 devstack cinder-volume[76027]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 18:26:47 devstack cinder-volume[76027]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 18:26:47 devstack cinder-volume[76027]: we strongly recommend against using it for new projects.
Nov 05 18:26:47 devstack cinder-volume[76027]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 18:26:47 devstack cinder-volume[76027]: framework.  For more detail see
Nov 05 18:26:47 devstack cinder-volume[76027]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 18:26:47 devstack cinder-volume[76027]:   import eventlet  # noqa
Nov 05 18:26:50 devstack cinder-volume[76027]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76027) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 18:26:50 devstack cinder-volume[76027]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76027) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 18:26:50 devstack cinder-volume[76027]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76027) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 18:26:51 devstack cinder-volume[76027]: INFO dbcounter [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Registered counter for database cinder
Nov 05 18:26:51 devstack cinder-volume[76027]: DEBUG oslo_db.sqlalchemy.engines [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG dbcounter [-] [76027] Writer thread running {{(pid=76027) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 18:26:52 devstack cinder-volume[76027]: INFO cinder.rpc [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 18:26:52 devstack cinder-volume[76027]: INFO cinder.rpc [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_db.sqlalchemy.engines [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:26:52 devstack cinder-volume[76027]: INFO cinder.volume.manager [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Determined volume DB was empty at startup.
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG cinder.volume.manager [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76027) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 18:26:52 devstack cinder-volume[76027]: INFO cinder.volume.manager [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 18:26:52 devstack cinder-volume[76027]: WARNING stevedore.named [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 18:26:52 devstack cinder-volume[76027]: WARNING castellan.key_manager [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 18:26:52 devstack cinder-volume[76027]: WARNING cinder.keymgr.conf_key_mgr [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG cinder.volume.drivers.lvm [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76027) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_concurrency.processutils [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76027) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_concurrency.processutils [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] CMD "cinder-rtstool verify" returned: 0 in 0.409s {{(pid=76027) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_db.sqlalchemy.engines [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:26:52 devstack cinder-volume[76027]: INFO cinder.rpc [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 05 18:26:52 devstack cinder-volume[76027]: INFO cinder.rpc [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 05 18:26:52 devstack cinder-volume[76027]: WARNING stevedore.named [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 18:26:52 devstack cinder-volume[76027]: WARNING castellan.key_manager [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 18:26:52 devstack cinder-volume[76027]: INFO cinder.volume.manager [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_db.sqlalchemy.engines [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:26:52 devstack cinder-volume[76027]: INFO oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Starting 1 workers
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Started child 76174 {{(pid=76027) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Full set of CONF: {{(pid=76027) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] ******************************************************************************** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Configuration options gathered from: {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 18:26:52 devstack cinder-volume[76174]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] ================================================================================ {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] allow_availability_zone_fallback = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] allow_compression_on_image_upload = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] allowed_direct_url_schemes     = [] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] api_rate_limit                 = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] auth_strategy                  = keystone {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] az_cache_duration              = 3600 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_availability_zone      = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_host                   = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_name                   = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_stats_polling_interval = 60 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backup_api_class               = cinder.backup.api.API {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backup_name_template           = backup-%s {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backup_use_same_host           = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backup_use_temp_snapshot       = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] chap_password                  = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] chap_username                  =  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cinder_internal_tenant_project_id = 07ed71ffd8c64ee3b9c3f3f074d1f33a {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cinder_internal_tenant_user_id = 86ae8998bd5a445e81d15ce6866f5b9c {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cloned_volume_same_az          = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cluster                        = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] compression_format             = gzip {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] config_dir                     = [] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] config_source                  = [] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] control_exchange               = openstack {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] debug                          = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] default_availability_zone      = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] default_group_type             = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] default_volume_type            = lvmdriver-1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] disk_geometry                  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] driver_client_cert             = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] driver_client_cert_key         = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] driver_data_namespace          = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] driver_ssl_cert_path           = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] driver_ssl_cert_verify         = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] driver_use_ssl                 = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] enable_force_upload            = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] enable_new_services            = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] enable_unsupported_driver      = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] enforce_multipath_for_image_xfer = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] filter_function                = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance_api_insecure            = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance_api_servers             = ['http://192.168.122.19/image'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance_api_ssl_compression     = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance_ca_certificates_file    = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance_certfile                = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance_keyfile                 = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance_num_retries             = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance_request_timeout         = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] goodness_function              = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] graceful_shutdown_timeout      = 5 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] group_api_class                = cinder.group.api.API {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] host                           = devstack {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_compress_on_upload       = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_conversion_address_space_limit = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_conversion_cpu_limit     = 60 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_conversion_disable       = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_introspection_address_space_limit = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_introspection_cpu_limit  = 60 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_upload_use_cinder_backend = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_upload_use_internal_tenant = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_volume_cache_enabled     = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_volume_cache_max_count   = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] image_volume_cache_max_size_gb = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] init_host_max_objects_retrieval = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] iscsi_target_flags             =  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] iscsi_write_cache              = on {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] iser_helper                    = tgtadm {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] iser_ip_address                = 192.168.122.19 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] iser_port                      = 3260 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] log_color                      = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] log_config_append              = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] log_dir                        = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] log_file                       = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] log_options                    = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] log_rotate_interval            = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] log_rotate_interval_type       = days {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] log_rotation_type              = none {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] max_age                        = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] max_logfile_count              = 30 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] max_logfile_size_mb            = 200 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] max_over_subscription_ratio    = 20.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] message_reap_interval          = 86400 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] message_ttl                    = 2592000 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] migration_create_volume_timeout_secs = 300 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] monkey_patch                   = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] monkey_patch_modules           = [] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] my_ip                          = 192.168.122.19 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] no_snapshot_gb_quota           = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] num_iser_scan_tries            = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76174]: INFO cinder.volume.manager [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 05 18:26:52 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] num_shell_tries                = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] num_volume_device_scan_tries   = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] nvmeof_conn_info_version       = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] nvmet_ns_id                    = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] nvmet_port_id                  = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] osapi_max_limit                = 1000 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] osapi_volume_ext_list          = [] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] osapi_volume_listen_port       = 8776 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] osapi_volume_use_ssl           = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] osapi_volume_workers           = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] per_volume_size_limit          = -1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] periodic_fuzzy_delay           = 60 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] periodic_interval              = 60 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] public_endpoint                = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] publish_errors                 = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] quota_backup_gigabytes         = 1000 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] quota_backups                  = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] quota_gigabytes                = 1000 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] quota_groups                   = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] quota_snapshots                = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] quota_volumes                  = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] rate_limit_burst               = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] rate_limit_except_level        = CRITICAL {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] rate_limit_interval            = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] reinit_driver_count            = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] replication_device             = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] report_discard_supported       = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] report_interval                = 120 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] reservation_clean_interval     = 86400 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] reservation_expire             = 86400 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] reserved_image_namespaces      = [] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] reserved_percentage            = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] rpc_response_timeout           = 120 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] run_external_periodic_tasks    = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:52 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] scst_target_driver             = iscsi {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] scst_target_iqn_name           = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_down_time              = 720 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] shell_completion               = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] snapshot_name_template         = snapshot-%s {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] snapshot_same_host             = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] split_loggers                  = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] state_path                     = /opt/stack/data/cinder {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] storage_availability_zone      = nova {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] storage_protocol               = iSCSI {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] syslog_log_facility            = LOG_USER {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] target_helper                  = lioadm {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] target_ip_address              = 192.168.122.19 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] target_port                    = 3260 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] target_protocol                = iscsi {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] target_secondary_ip_addresses  = [] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] trace_flags                    = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] transport_url                  = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] until_refresh                  = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] use_chap_auth                  = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] use_default_quota_class        = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] use_journal                    = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] use_json                       = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] use_multipath_for_image_xfer   = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] use_stderr                     = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] use_syslog                     = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] verify_glance_signatures       = enabled {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_api_class               = cinder.volume.api.API {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_backend_name            = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_clear                   = zero {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_clear_ionice            = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_clear_size              = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_copy_bps_limit          = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_dd_blocksize            = 1M {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_name_template           = volume-%s {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_service_inithost_offload = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volume_usage_audit_period      = month {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] zoning_mode                    = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_concurrency.disable_process_locking = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.059s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.auth_section = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.auth_type   = password {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.auth_version = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.cache       = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.certfile    = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.include_service_catalog = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.insecure    = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.interface   = public {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.keyfile     = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_password = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcache_username = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.region_name = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.service_type = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.19/identity {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.backend                  = dogpile.cache.null {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.backend_argument         = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.backend_expiration_time  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.config_prefix            = cache.oslo {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.debug_cache_backend      = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.enable_retry_client      = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.enable_socket_keepalive  = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.enabled                  = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.expiration_time          = 600 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.hashclient_retry_attempts = 2 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.memcache_dead_retry      = 300 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.memcache_sasl_enabled    = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.password                 = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.proxies                  = [] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.redis_db                 = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.redis_server             = localhost:6379 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.retry_attempts           = 2 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.retry_delay              = 0.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.socket_keepalive_count   = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.socket_keepalive_idle    = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.socket_keepalive_interval = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.socket_timeout           = 1.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.tls_allowed_ciphers      = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.tls_cafile               = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.tls_certfile             = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.tls_enabled              = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.tls_keyfile              = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cache.username                 = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] coordination.backend_url       = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.asyncio_connection    = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.asyncio_slave_connection = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.backend               = sqlalchemy {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.connection            = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.connection_debug      = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.connection_parameters =  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.connection_recycle_time = 3600 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.connection_trace      = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.db_inc_retry_interval = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.db_max_retries        = 20 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.db_max_retry_interval = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.db_retry_interval     = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.max_overflow          = 50 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.max_pool_size         = 5 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.max_retries           = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.mysql_wsrep_sync_wait = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.pool_timeout          = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.retry_interval        = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.slave_connection      = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.sqlite_synchronous    = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.synchronous_reader    = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] database.use_db_reconnect      = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_tracing.insecure = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.connection_string     = messaging:// {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.enabled               = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.es_doc_type           = notification {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.es_scroll_size        = 10000 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.es_scroll_time        = 2m {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.filter_error_trace    = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.hmac_keys             = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.sentinel_service_name = mymaster {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.socket_timeout        = 0.1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.trace_requests        = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler.trace_sqlalchemy      = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler_jaeger.process_tags   = {} {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler_jaeger.service_name_prefix = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] profiler_otlp.service_name_prefix = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_policy.enforce_new_defaults = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_policy.policy_default_rule = default {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] privsep_osbrick.group          = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] privsep_osbrick.helper_command = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] privsep_osbrick.user           = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cinder_sys_admin.group         = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cinder_sys_admin.helper_command = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] cinder_sys_admin.user          = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.auth_section      = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.auth_type         = password {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.cafile            = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.certfile          = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.collect_timing    = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.insecure          = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.keyfile           = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.send_service_user_token = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.split_loggers     = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.timeout           = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.tls_ciphers       = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] service_user.tls_min_version   = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.auth_section            = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.auth_type               = password {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.certfile                = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.collect_timing          = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.insecure                = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.keyfile                 = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.region_name             = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.split_loggers           = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.timeout                 = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.tls_ciphers             = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] glance.tls_min_version         = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack sudo[76216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.backend_availability_zone = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack sudo[76216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.chap_password = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.chap_username =  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.disk_geometry = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.driver_client_cert = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.driver_client_cert_key = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.driver_data_namespace = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.driver_use_ssl = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.extra_capabilities = {} {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.filter_function = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.goodness_function = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.iscsi_target_flags =  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.iscsi_write_cache = on {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.iser_ip_address = 192.168.122.19 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.iser_port     = 3260 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.lvm_share_target = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.lvm_type      = auto {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.num_shell_tries = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.replication_device = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.report_discard_supported = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.reserved_percentage = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.target_helper = tgtadm {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.target_ip_address = 192.168.122.19 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.target_port   = 3260 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.target_protocol = iscsi {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.trace_flags   = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.unique_fqdn_network = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.use_chap_auth = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.volume_backend_name = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.volume_clear  = zero {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.volume_clear_ionice = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.volume_clear_size = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_reports.file_event_handler = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_reports.log_dir           = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.backend_host       = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.chap_password      = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.chap_username      = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.disk_geometry      = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.driver_client_cert = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.extra_capabilities = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.filter_function    = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.goodness_function  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.iser_helper        = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.iser_port          = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.lvm_type           = auto {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.replication_device = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.report_discard_supported = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.reserved_percentage = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.scst_target_driver = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.storage_protocol   = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.target_ip_address  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.target_port        = 3260 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.trace_flags        = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.volume_clear       = zero {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] lvmdriver-1.volumes_dir        = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_notifications.driver = [] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_notifications.retry = -1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] key_manager.fixed_key          = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.barbican_api_version  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.barbican_endpoint     = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.barbican_endpoint_type = public {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.barbican_region_name  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.cafile                = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.certfile              = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.collect_timing        = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.insecure              = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.keyfile               = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.number_of_retries     = 60 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.retry_delay           = 1 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.send_service_user_token = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.split_loggers         = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.timeout               = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.tls_ciphers           = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.tls_min_version       = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.verify_ssl            = True {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican.verify_ssl_path       = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.auth_section = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.auth_type = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.cafile   = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.certfile = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.collect_timing = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.insecure = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.keyfile  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.split_loggers = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.timeout  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.tls_ciphers = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] barbican_service_user.tls_min_version = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.approle_role_id          = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.approle_secret_id        = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.auth_method              = approle {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.auth_path                = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.kv_mountpoint            = secret {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.kv_path                  = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.kv_version               = 2 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.namespace                = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.root_token_id            = **** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.ssl_ca_crt_file          = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.timeout                  = 60.0 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.token_file               = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.token_role               = None {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.use_ssl                  = False {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:26:53 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] ******************************************************************************** {{(pid=76027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 18:26:53 devstack sudo[76216]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.399s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:53 devstack sudo[76349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:26:53 devstack sudo[76349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:53 devstack sudo[76349]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.259s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:26:53 devstack cinder-volume[76174]: INFO cinder.brick.local_dev.lvm [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:53 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:53 devstack sudo[76439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 18:26:53 devstack sudo[76439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:54 devstack sudo[76439]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG cinder.brick.local_dev.lvm [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76174) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:54 devstack sudo[76525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:26:54 devstack sudo[76525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:54 devstack sudo[76525]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.533s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:54 devstack sudo[76709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:26:54 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:54 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.322s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:54 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:54 devstack sudo[76790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 05 18:26:54 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:55 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:55 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.250s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:55 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:55 devstack sudo[76798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 18:26:55 devstack sudo[76798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:55 devstack sudo[76798]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:55 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:55 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:55 devstack sudo[76878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 18:26:55 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:55 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:55 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:55 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:55 devstack sudo[76887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:26:55 devstack sudo[76887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:56 devstack sudo[76887]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:56 devstack sudo[76970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:26:56 devstack sudo[76970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:56 devstack sudo[76970]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:56 devstack sudo[76974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:26:56 devstack sudo[76974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:56 devstack sudo[76974]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:56 devstack cinder-volume[76174]: INFO cinder.volume.drivers.lvm [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:56 devstack sudo[76978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:26:56 devstack sudo[76978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:56 devstack sudo[76978]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG cinder.volume.drivers.lvm [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Updating volume stats {{(pid=76174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 18:26:56 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:56 devstack sudo[76987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 18:26:56 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:57 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:57 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:57 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:57 devstack sudo[76990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:26:57 devstack sudo[76990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:57 devstack sudo[76990]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:57 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:57 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:57 devstack sudo[76993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:26:57 devstack sudo[76993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:57 devstack sudo[76993]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:57 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:57 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:57 devstack sudo[76996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:26:57 devstack sudo[76996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:58 devstack sudo[76996]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:58 devstack cinder-volume[76174]: INFO cinder.volume.driver [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG cinder.volume.driver [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76174) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG oslo_db.sqlalchemy.engines [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG dbcounter [-] [76174] Writer thread running {{(pid=76174) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG cinder.db.api [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Building query based on filter {{(pid=76174) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG cinder.image.image_utils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76174) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 18:26:58 devstack cinder-volume[76174]: INFO cinder.keymgr.migration [None req-ffe0c444-ac43-460e-a181-9fecbb4baa9f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG cinder.volume.drivers.lvm [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Updating volume stats {{(pid=76174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:58 devstack sudo[77000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 18:26:58 devstack sudo[77000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:58 devstack sudo[77000]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:58 devstack sudo[77004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:26:58 devstack sudo[77004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:58 devstack sudo[77004]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:58 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:58 devstack sudo[77008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:26:58 devstack sudo[77008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:59 devstack sudo[77008]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:59 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:59 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:59 devstack sudo[77011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:26:59 devstack sudo[77011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:59 devstack sudo[77011]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:59 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:59 devstack cinder-volume[76174]: DEBUG cinder.manager [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Notifying Schedulers of capabilities ... {{(pid=76174) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:26:59 devstack cinder-volume[76174]: INFO cinder.volume.manager [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Driver initialization completed successfully.
Nov 05 18:26:59 devstack cinder-volume[76174]: INFO cinder.manager [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Initiating service 2 cleanup
Nov 05 18:26:59 devstack cinder-volume[76174]: INFO cinder.manager [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Service 2 cleanup completed.
Nov 05 18:26:59 devstack cinder-volume[76174]: DEBUG cinder.service [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Creating RPC server for service cinder-volume {{(pid=76174) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 18:26:59 devstack cinder-volume[76174]: DEBUG cinder.service [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76174) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 18:26:59 devstack cinder-volume[76174]: INFO cinder.volume.manager [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 05 18:26:59 devstack cinder-volume[76174]: DEBUG cinder.volume.drivers.lvm [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Updating volume stats {{(pid=76174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 18:26:59 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:59 devstack sudo[77015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 18:26:59 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:26:59 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root
Nov 05 18:26:59 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:26:59 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:26:59 devstack sudo[77019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:26:59 devstack sudo[77019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:27:00 devstack sudo[77019]: pam_unix(sudo:session): session closed for user root
Nov 05 18:27:00 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:27:00 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:27:00 devstack sudo[77025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:27:00 devstack sudo[77025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:27:00 devstack sudo[77025]: pam_unix(sudo:session): session closed for user root
Nov 05 18:27:00 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:27:00 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:27:00 devstack sudo[77028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:27:00 devstack sudo[77028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:27:00 devstack sudo[77028]: pam_unix(sudo:session): session closed for user root
Nov 05 18:27:00 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:27:00 devstack cinder-volume[76174]: INFO cinder.volume.manager [None req-7e5b44c5-7753-4582-bfe6-0b44934af5a0 None None] Driver post RPC initialization completed successfully.
Nov 05 18:27:02 devstack cinder-volume[76027]: DEBUG dbcounter [-] [76027] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76027) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:27:10 devstack cinder-volume[76174]: DEBUG dbcounter [-] [76174] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76174) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:27:10 devstack cinder-volume[76174]: DEBUG dbcounter [-] [76174] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76174) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:27:13 devstack cinder-volume[76174]: DEBUG oslo_service.periodic_task [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running periodic task VolumeManager._thread_info {{(pid=76174) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:27:13 devstack cinder-volume[76174]: DEBUG cinder.volume.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] thread count: 6 {{(pid=76174) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:27:13 devstack cinder-volume[76174]: DEBUG cinder.volume.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] thread info: [<_MainThread(MainThread, started 131184416301184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131184312316288)>, <Thread(Thread-3 (stat_writer), started daemon 131184301347072)>, <Thread(Rabbit-heartbeat, started daemon 131184304514752)>, <Thread(Thread-5 (_runner), started daemon 131184300855808)>, <Thread(Thread-7 (_runner), started daemon 131184298904256)>] {{(pid=76174) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:28:13 devstack cinder-volume[76174]: DEBUG oslo_service.periodic_task [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76174) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:28:13 devstack cinder-volume[76174]: DEBUG cinder.volume.drivers.lvm [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Updating volume stats {{(pid=76174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 18:28:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:28:13 devstack sudo[79514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 18:28:13 devstack sudo[79514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:28:13 devstack sudo[79514]: pam_unix(sudo:session): session closed for user root
Nov 05 18:28:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:28:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:28:13 devstack sudo[79517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:28:13 devstack sudo[79517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:28:14 devstack sudo[79517]: pam_unix(sudo:session): session closed for user root
Nov 05 18:28:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:28:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:28:14 devstack sudo[79548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:28:14 devstack sudo[79548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:28:14 devstack sudo[79548]: pam_unix(sudo:session): session closed for user root
Nov 05 18:28:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:28:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:28:14 devstack sudo[79551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:28:14 devstack sudo[79551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:28:14 devstack sudo[79551]: pam_unix(sudo:session): session closed for user root
Nov 05 18:28:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:28:14 devstack cinder-volume[76174]: DEBUG cinder.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Notifying Schedulers of capabilities ... {{(pid=76174) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:28:14 devstack cinder-volume[76174]: DEBUG oslo_service.periodic_task [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running periodic task VolumeManager._thread_info {{(pid=76174) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:28:14 devstack cinder-volume[76174]: DEBUG cinder.volume.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] thread count: 6 {{(pid=76174) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:28:14 devstack cinder-volume[76174]: DEBUG cinder.volume.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] thread info: [<_MainThread(MainThread, started 131184416301184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131184312316288)>, <Thread(Thread-3 (stat_writer), started daemon 131184301347072)>, <Thread(Rabbit-heartbeat, started daemon 131184304514752)>, <Thread(Thread-5 (_runner), started daemon 131184300855808)>, <Thread(Thread-7 (_runner), started daemon 131184298904256)>] {{(pid=76174) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:29:10 devstack cinder-volume[76174]: DEBUG dbcounter [-] [76174] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76174) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:29:13 devstack cinder-volume[76174]: DEBUG oslo_service.periodic_task [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76174) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:29:13 devstack cinder-volume[76174]: DEBUG cinder.volume.drivers.lvm [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Updating volume stats {{(pid=76174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 18:29:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:29:13 devstack sudo[82543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 18:29:13 devstack sudo[82543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:29:13 devstack sudo[82543]: pam_unix(sudo:session): session closed for user root
Nov 05 18:29:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:29:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:29:13 devstack sudo[82547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:29:13 devstack sudo[82547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:29:14 devstack sudo[82547]: pam_unix(sudo:session): session closed for user root
Nov 05 18:29:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:29:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:29:14 devstack sudo[82555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:29:14 devstack sudo[82555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:29:14 devstack sudo[82555]: pam_unix(sudo:session): session closed for user root
Nov 05 18:29:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:29:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:29:14 devstack sudo[82563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:29:14 devstack sudo[82563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:29:14 devstack sudo[82563]: pam_unix(sudo:session): session closed for user root
Nov 05 18:29:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:29:14 devstack cinder-volume[76174]: DEBUG cinder.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Notifying Schedulers of capabilities ... {{(pid=76174) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:29:14 devstack cinder-volume[76174]: DEBUG oslo_service.periodic_task [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running periodic task VolumeManager._thread_info {{(pid=76174) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:29:14 devstack cinder-volume[76174]: DEBUG cinder.volume.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] thread count: 6 {{(pid=76174) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:29:14 devstack cinder-volume[76174]: DEBUG cinder.volume.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] thread info: [<_MainThread(MainThread, started 131184416301184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131184312316288)>, <Thread(Thread-3 (stat_writer), started daemon 131184301347072)>, <Thread(Rabbit-heartbeat, started daemon 131184304514752)>, <Thread(Thread-5 (_runner), started daemon 131184300855808)>, <Thread(Thread-7 (_runner), started daemon 131184298904256)>] {{(pid=76174) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:30:13 devstack cinder-volume[76174]: DEBUG oslo_service.periodic_task [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76174) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:30:13 devstack cinder-volume[76174]: DEBUG cinder.volume.drivers.lvm [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Updating volume stats {{(pid=76174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 18:30:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:30:13 devstack sudo[84737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 18:30:13 devstack sudo[84737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:30:13 devstack sudo[84737]: pam_unix(sudo:session): session closed for user root
Nov 05 18:30:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:30:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:30:13 devstack sudo[84743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:30:13 devstack sudo[84743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:30:14 devstack sudo[84743]: pam_unix(sudo:session): session closed for user root
Nov 05 18:30:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:30:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:30:14 devstack sudo[84765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:30:14 devstack sudo[84765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:30:14 devstack sudo[84765]: pam_unix(sudo:session): session closed for user root
Nov 05 18:30:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:30:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:30:14 devstack sudo[84770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:30:14 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:30:14 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root
Nov 05 18:30:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:30:14 devstack cinder-volume[76174]: DEBUG cinder.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Notifying Schedulers of capabilities ... {{(pid=76174) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:31:10 devstack cinder-volume[76174]: DEBUG dbcounter [-] [76174] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76174) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:31:13 devstack cinder-volume[76174]: DEBUG oslo_service.periodic_task [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76174) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:31:13 devstack cinder-volume[76174]: DEBUG cinder.volume.drivers.lvm [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Updating volume stats {{(pid=76174) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 18:31:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:13 devstack sudo[85870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 18:31:13 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:13 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:13 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:13 devstack sudo[85880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:31:13 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:14 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:14 devstack sudo[85883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 18:31:14 devstack sudo[85883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:14 devstack sudo[85883]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:14 devstack sudo[85887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 18:31:14 devstack sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:14 devstack sudo[85887]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:14 devstack cinder-volume[76174]: DEBUG oslo_concurrency.processutils [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76174) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:14 devstack cinder-volume[76174]: DEBUG cinder.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Notifying Schedulers of capabilities ... {{(pid=76174) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:31:14 devstack cinder-volume[76174]: DEBUG oslo_service.periodic_task [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] Running periodic task VolumeManager._thread_info {{(pid=76174) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:31:14 devstack cinder-volume[76174]: DEBUG cinder.volume.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] thread count: 6 {{(pid=76174) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:31:14 devstack cinder-volume[76174]: DEBUG cinder.volume.manager [None req-698fa550-512b-401c-abf5-b779e50ff2b5 None None] thread info: [<_MainThread(MainThread, started 131184416301184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131184312316288)>, <Thread(Thread-3 (stat_writer), started daemon 131184301347072)>, <Thread(Rabbit-heartbeat, started daemon 131184304514752)>, <Thread(Thread-5 (_runner), started daemon 131184300855808)>, <Thread(Thread-7 (_runner), started daemon 131184298904256)>] {{(pid=76174) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:31:21 devstack cinder-volume[76027]: INFO oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Caught SIGTERM, stopping children
Nov 05 18:31:21 devstack cinder-volume[76027]: DEBUG oslo_concurrency.lockutils [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Acquiring lock "singleton_lock" {{(pid=76027) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 18:31:21 devstack cinder-volume[76027]: DEBUG oslo_concurrency.lockutils [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Acquired lock "singleton_lock" {{(pid=76027) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 18:31:21 devstack cinder-volume[76027]: DEBUG oslo_concurrency.lockutils [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Releasing lock "singleton_lock" {{(pid=76027) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 18:31:21 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Stop services. {{(pid=76027) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 18:31:21 devstack cinder-volume[76027]: DEBUG oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Killing children. {{(pid=76027) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 18:31:21 devstack cinder-volume[76027]: INFO oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Waiting on 1 children to exit
Nov 05 18:31:24 devstack cinder-volume[76174]: DEBUG oslo_concurrency.lockutils [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Acquiring lock "singleton_lock" {{(pid=76174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 18:31:24 devstack cinder-volume[76174]: DEBUG oslo_concurrency.lockutils [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Acquired lock "singleton_lock" {{(pid=76174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 18:31:24 devstack cinder-volume[76174]: DEBUG oslo_concurrency.lockutils [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Releasing lock "singleton_lock" {{(pid=76174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 18:31:24 devstack cinder-volume[76174]: WARNING amqp [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 18:31:24 devstack cinder-volume[76174]: WARNING amqp [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 18:31:24 devstack cinder-volume[76027]: INFO oslo_service.backend._eventlet.service [None req-3e8db45b-141d-4b09-b76b-bd180266e853 None None] Child 76174 exited with status 0
Nov 05 18:31:24 devstack cinder-volume[86211]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 18:31:24 devstack cinder-volume[86211]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 18:31:24 devstack cinder-volume[86211]: we strongly recommend against using it for new projects.
Nov 05 18:31:24 devstack cinder-volume[86211]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 18:31:24 devstack cinder-volume[86211]: framework.  For more detail see
Nov 05 18:31:24 devstack cinder-volume[86211]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 18:31:24 devstack cinder-volume[86211]:   import eventlet  # noqa
Nov 05 18:31:27 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 18:31:27 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 18:31:27 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 18:31:27 devstack cinder-volume[86211]: INFO dbcounter [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Registered counter for database cinder
Nov 05 18:31:27 devstack cinder-volume[86211]: DEBUG oslo_db.sqlalchemy.engines [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG dbcounter [-] [86211] Writer thread running {{(pid=86211) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 18:31:28 devstack cinder-volume[86211]: INFO cinder.rpc [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 18:31:28 devstack cinder-volume[86211]: INFO cinder.rpc [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_db.sqlalchemy.engines [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:31:28 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Determined volume DB was empty at startup.
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG cinder.volume.manager [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86211) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 18:31:28 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 18:31:28 devstack cinder-volume[86211]: WARNING stevedore.named [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 18:31:28 devstack cinder-volume[86211]: WARNING castellan.key_manager [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 18:31:28 devstack cinder-volume[86211]: WARNING cinder.keymgr.conf_key_mgr [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 18:31:28 devstack cinder-volume[86211]: INFO cinder.volume.manager [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_db.sqlalchemy.engines [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86211) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:31:28 devstack cinder-volume[86211]: INFO oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Starting 1 workers
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Started child 86428 {{(pid=86211) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Full set of CONF: {{(pid=86211) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] ******************************************************************************** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Configuration options gathered from: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] ================================================================================ {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] allow_availability_zone_fallback = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] allow_compression_on_image_upload = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] allowed_direct_url_schemes     = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] api_rate_limit                 = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] auth_strategy                  = keystone {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86428]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_availability_zone      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_host                   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_name                   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_stats_polling_interval = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backup_api_class               = cinder.backup.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backup_name_template           = backup-%s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backup_use_same_host           = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backup_use_temp_snapshot       = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] chap_password                  = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] chap_username                  =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cinder_internal_tenant_project_id = 07ed71ffd8c64ee3b9c3f3f074d1f33a {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cinder_internal_tenant_user_id = 86ae8998bd5a445e81d15ce6866f5b9c {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cluster                        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] compression_format             = gzip {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] compute_api_class              = cinder.compute.nova.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] config_dir                     = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] config_source                  = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] control_exchange               = openstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] debug                          = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] default_availability_zone      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] default_group_type             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] default_volume_type            = QuobyteHD {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] disk_geometry                  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] driver_client_cert             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] driver_client_cert_key         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] driver_data_namespace          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] driver_ssl_cert_path           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] driver_ssl_cert_verify         = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] driver_use_ssl                 = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] enable_new_services            = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] enable_unsupported_driver      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] enabled_backends               = ['QuobyteHD'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] enforce_multipath_for_image_xfer = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] filter_function                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance_api_insecure            = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance_api_servers             = ['http://192.168.122.19/image'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance_api_ssl_compression     = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance_ca_certificates_file    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance_catalog_info            = image:glance:publicURL {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance_certfile                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance_keyfile                 = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance_num_retries             = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance_request_timeout         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] goodness_function              = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] graceful_shutdown_timeout      = 5 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] group_api_class                = cinder.group.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] host                           = devstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_compress_on_upload       = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_conversion_address_space_limit = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_conversion_cpu_limit     = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_conversion_disable       = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_introspection_address_space_limit = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_introspection_cpu_limit  = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_upload_use_cinder_backend = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_upload_use_internal_tenant = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_volume_cache_enabled     = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_volume_cache_max_count   = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] image_volume_cache_max_size_gb = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] init_host_max_objects_retrieval = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] instance_format                = [instance: %(uuid)s]  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] iscsi_target_flags             =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] iscsi_write_cache              = on {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] iser_helper                    = tgtadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] iser_ip_address                = 192.168.122.19 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] iser_port                      = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] log_color                      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] log_config_append              = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] log_dir                        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] log_file                       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] log_options                    = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] log_rotate_interval            = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] log_rotate_interval_type       = days {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] log_rotation_type              = none {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] max_age                        = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] max_logfile_count              = 30 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] max_logfile_size_mb            = 200 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] max_over_subscription_ratio    = 20.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] message_reap_interval          = 86400 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] message_ttl                    = 2592000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] migration_create_volume_timeout_secs = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] monkey_patch                   = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] monkey_patch_modules           = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] my_ip                          = 192.168.122.19 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] no_snapshot_gb_quota           = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] num_iser_scan_tries            = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] num_shell_tries                = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] num_volume_device_scan_tries   = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] nvmeof_conn_info_version       = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] nvmet_ns_id                    = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] nvmet_port_id                  = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] osapi_max_limit                = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] osapi_volume_ext_list          = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] osapi_volume_listen_port       = 8776 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] osapi_volume_use_ssl           = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] osapi_volume_workers           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] per_volume_size_limit          = -1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] periodic_fuzzy_delay           = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] periodic_interval              = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] public_endpoint                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] publish_errors                 = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] quota_backup_gigabytes         = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] quota_backups                  = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] quota_gigabytes                = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] quota_groups                   = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] quota_snapshots                = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] quota_volumes                  = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] rate_limit_burst               = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] rate_limit_except_level        = CRITICAL {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] rate_limit_interval            = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] reinit_driver_count            = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] replication_device             = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] report_discard_supported       = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] report_interval                = 120 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] reservation_clean_interval     = 86400 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] reservation_expire             = 86400 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] reserved_image_namespaces      = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] reserved_percentage            = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] rpc_response_timeout           = 120 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] run_external_periodic_tasks    = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] scst_target_driver             = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] scst_target_iqn_name           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_down_time              = 720 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] shell_completion               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] snapshot_name_template         = snapshot-%s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] split_loggers                  = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] state_path                     = /opt/stack/data/cinder {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] storage_availability_zone      = nova {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] storage_protocol               = iSCSI {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] syslog_log_facility            = LOG_USER {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] target_helper                  = lioadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86428]: INFO cinder.volume.manager [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] target_ip_address              = 192.168.122.19 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86428]: DEBUG cinder.volume.drivers.remotefs [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86428) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] target_port                    = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] target_protocol                = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] target_secondary_ip_addresses  = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] trace_flags                    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] transport_url                  = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] until_refresh                  = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] use_chap_auth                  = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] use_default_quota_class        = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] use_journal                    = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] use_json                       = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] use_multipath_for_image_xfer   = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] use_stderr                     = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] use_syslog                     = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] verify_glance_signatures       = enabled {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_api_class               = cinder.volume.api.API {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_backend_name            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_clear                   = zero {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_clear_ionice            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_clear_size              = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_copy_bps_limit          = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_dd_blocksize            = 1M {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_name_template           = volume-%s {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_service_inithost_offload = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volume_usage_audit_period      = month {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] zoning_mode                    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_concurrency.disable_process_locking = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.auth_section = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.auth_type   = password {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.auth_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.cache       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.certfile    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.delay_auth_decision = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.http_connect_timeout = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.include_service_catalog = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.insecure    = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.interface   = public {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.keyfile     = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcache_username = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.region_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.service_token_roles_required = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.service_type = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.token_cache_time = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.19/identity {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.backend                  = dogpile.cache.null {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.backend_argument         = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.backend_expiration_time  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.config_prefix            = cache.oslo {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.debug_cache_backend      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.enable_retry_client      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.enable_socket_keepalive  = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.enabled                  = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.expiration_time          = 600 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.hashclient_retry_attempts = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.memcache_dead_retry      = 300 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.memcache_pool_maxsize    = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.memcache_sasl_enabled    = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.password                 = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.proxies                  = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.redis_db                 = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.redis_sentinel_service_name = mymaster {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.redis_server             = localhost:6379 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.retry_attempts           = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.retry_delay              = 0.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.socket_keepalive_count   = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.socket_keepalive_idle    = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.socket_keepalive_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.socket_timeout           = 1.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.tls_allowed_ciphers      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.tls_cafile               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.tls_certfile             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.tls_enabled              = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.tls_keyfile              = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cache.username                 = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] coordination.backend_url       = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.asyncio_connection    = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.asyncio_slave_connection = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.backend               = sqlalchemy {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.connection            = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.connection_debug      = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.connection_parameters =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.connection_recycle_time = 3600 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.connection_trace      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.db_inc_retry_interval = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.db_max_retries        = 20 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.db_max_retry_interval = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.db_retry_interval     = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.max_overflow          = 50 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.max_pool_size         = 5 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.max_retries           = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.mysql_wsrep_sync_wait = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.pool_timeout          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.retry_interval        = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.slave_connection      = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.sqlite_synchronous    = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.synchronous_reader    = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] database.use_db_reconnect      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_tracing.insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.connection_string     = messaging:// {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.enabled               = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.es_doc_type           = notification {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.es_scroll_size        = 10000 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.es_scroll_time        = 2m {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.filter_error_trace    = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.hmac_keys             = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.sentinel_service_name = mymaster {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.socket_timeout        = 0.1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.trace_requests        = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler.trace_sqlalchemy      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler_jaeger.process_tags   = {} {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler_jaeger.service_name_prefix = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] profiler_otlp.service_name_prefix = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_policy.enforce_new_defaults = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_policy.policy_default_rule = default {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_policy.policy_file        = policy.yaml {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] privsep_osbrick.group          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] privsep_osbrick.helper_command = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] privsep_osbrick.user           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cinder_sys_admin.group         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cinder_sys_admin.helper_command = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] cinder_sys_admin.user          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.auth_section      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.auth_type         = password {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.cafile            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.certfile          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.collect_timing    = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.insecure          = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.keyfile           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.send_service_user_token = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.split_loggers     = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.timeout           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.tls_ciphers       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] service_user.tls_min_version   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.auth_section            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.auth_type               = password {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.certfile                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.collect_timing          = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.insecure                = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.keyfile                 = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.region_name             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.split_loggers           = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.timeout                 = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.tls_ciphers             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] glance.tls_min_version         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.backend_availability_zone = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.chap_password = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.chap_username =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.disk_geometry = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.driver_client_cert = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.driver_client_cert_key = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.driver_data_namespace = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.driver_use_ssl = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.enable_unsupported_driver = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.extra_capabilities = {} {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.filter_function = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.goodness_function = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.iscsi_target_flags =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.iscsi_write_cache = on {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.iser_helper   = tgtadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.iser_ip_address = 192.168.122.19 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.iser_port     = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nas_host      =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nas_login     = admin {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nas_mount_options = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nas_password  = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nas_private_key =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nas_share_path =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.num_shell_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.nvmet_port_id = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.quobyte_client_cfg = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.quobyte_volume_url = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.replication_device = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.report_discard_supported = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.reserved_percentage = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.scst_target_driver = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.scst_target_iqn_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.storage_protocol = iSCSI {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.target_helper = tgtadm {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.target_ip_address = 192.168.122.19 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.target_port   = 3260 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.target_protocol = iscsi {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.trace_flags   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86428]: DEBUG cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86428) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.unique_fqdn_network = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.use_chap_auth = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.volume_backend_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.volume_clear  = zero {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86428]: WARNING cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.volume_clear_ionice = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.volume_clear_size = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_reports.file_event_handler = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_reports.log_dir           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.backend_availability_zone = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.backend_host         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86428]: WARNING cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.chap_password        = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.chap_username        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.chiscsi_conf         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Running cmd (subprocess): mount.quobyte {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.disk_geometry        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.driver_client_cert   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.driver_client_cert_key = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.driver_data_namespace = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.driver_use_ssl       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.extra_capabilities   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.filter_function      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.goodness_function    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.iser_helper          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.iser_ip_address      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.iser_port            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.iser_target_prefix   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nas_host             = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nas_login            = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nas_mount_options    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nas_password         = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nas_private_key      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nas_share_path       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nas_ssh_port         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.num_shell_tries      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.nvmet_port_id        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.replication_device   = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.report_discard_supported = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.reserved_percentage  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.scst_target_driver   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.storage_protocol     = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.target_helper        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.target_ip_address    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.target_port          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.target_prefix        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.target_protocol      = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.trace_flags          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.use_chap_auth        = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.volume_clear         = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.volume_clear_size    = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] QuobyteHD.volumes_dir          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.ssl      = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_notifications.driver = [] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_notifications.retry = -1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] oslo_messaging_notifications.transport_url = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] key_manager.fixed_key          = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.barbican_api_version  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.barbican_endpoint     = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.barbican_endpoint_type = public {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.barbican_region_name  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.cafile                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.certfile              = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack quobyte-client[86432]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.collect_timing        = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.insecure              = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.keyfile               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.number_of_retries     = 60 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.retry_delay           = 1 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.send_service_user_token = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.split_loggers         = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack quobyte-client[86432]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.timeout               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.tls_ciphers           = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.tls_min_version       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.verify_ssl            = True {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican.verify_ssl_path       = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.auth_section = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.auth_type = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.cafile   = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.certfile = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.collect_timing = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.insecure = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.keyfile  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.split_loggers = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.timeout  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.tls_ciphers = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] barbican_service_user.tls_min_version = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.approle_role_id          = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.approle_secret_id        = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.auth_method              = approle {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.auth_path                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.kv_mountpoint            = secret {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.kv_path                  = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.kv_version               = 2 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.namespace                = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.root_token_id            = **** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.ssl_ca_crt_file          = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.timeout                  = 60.0 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.token_file               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.token_role               = None {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.use_ssl                  = False {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:28 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] ******************************************************************************** {{(pid=86211) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 18:31:28 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] CMD "mount.quobyte" returned: 1 in 0.089s {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:28 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:31:28 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:31:28 devstack cinder-volume[86428]: DEBUG cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=86428) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:31:28 devstack cinder-volume[86428]: INFO cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 ...
Nov 05 18:31:28 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 -c /etc/quobyte/client-cinder.cfg {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:28 devstack sudo[86434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 -c /etc/quobyte/client-cinder.cfg
Nov 05 18:31:28 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:29 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.405s {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:29 devstack cinder-volume[86428]: INFO cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 succeeded
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=86428) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.415s {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:29 devstack sudo[86536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:31:29 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:29 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.232s {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:29 devstack cinder-volume[86428]: INFO cinder.volume.driver [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.volume.driver [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4418106079102, 'free_capacity_gb': 1773.4418106079102, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86428) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_db.sqlalchemy.engines [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86428) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG dbcounter [-] [86428] Writer thread running {{(pid=86428) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.db.api [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Building query based on filter {{(pid=86428) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.image.image_utils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86428) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 18:31:29 devstack cinder-volume[86428]: INFO cinder.keymgr.migration [None req-10e81aa7-c24f-4c42-b779-013de68fc46d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=86428) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=86428) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:29 devstack sudo[86540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:31:29 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:29 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.241s {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.manager [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Notifying Schedulers of capabilities ... {{(pid=86428) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:31:29 devstack cinder-volume[86428]: INFO cinder.volume.manager [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Driver initialization completed successfully.
Nov 05 18:31:29 devstack cinder-volume[86428]: INFO cinder.manager [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Initiating service 3 cleanup
Nov 05 18:31:29 devstack cinder-volume[86428]: INFO cinder.manager [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Service 3 cleanup completed.
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.service [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Creating RPC server for service cinder-volume {{(pid=86428) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.service [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86428) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 18:31:29 devstack cinder-volume[86428]: INFO cinder.volume.manager [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=86428) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG cinder.volume.drivers.quobyte [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=86428) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:31:29 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:30 devstack sudo[86543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:31:30 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:30 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:30 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.243s {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:30 devstack cinder-volume[86428]: INFO cinder.volume.manager [None req-c16e9f56-5981-47d7-b7b2-6c3f5adce495 None None] Driver post RPC initialization completed successfully.
Nov 05 18:31:34 devstack cinder-volume[86211]: INFO oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Caught SIGTERM, stopping children
Nov 05 18:31:34 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Acquiring lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 18:31:34 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Acquired lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 18:31:34 devstack cinder-volume[86211]: DEBUG oslo_concurrency.lockutils [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Releasing lock "singleton_lock" {{(pid=86211) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 18:31:34 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Stop services. {{(pid=86211) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 18:31:34 devstack cinder-volume[86211]: DEBUG oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Killing children. {{(pid=86211) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 18:31:34 devstack cinder-volume[86211]: INFO oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Waiting on 1 children to exit
Nov 05 18:31:34 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:31:34 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:31:34 devstack cinder-volume[86428]: DEBUG cinder.volume.drivers.quobyte [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=86428) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:31:34 devstack cinder-volume[86428]: DEBUG cinder.volume.drivers.quobyte [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=86428) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:31:34 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86428) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:31:34 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:34 devstack sudo[86772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:31:34 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:35 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:35 devstack cinder-volume[86428]: DEBUG oslo_concurrency.processutils [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.486s {{(pid=86428) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:35 devstack cinder-volume[86428]: DEBUG cinder.manager [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] Notifying Schedulers of capabilities ... {{(pid=86428) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] Unable to connect to AMQP server on 192.168.122.19:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server [None req-9048ee0d-63a4-4a90-b3bf-a363e4f41274 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.19:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     method()
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     return _publish(
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     listener(*args)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server 
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server 
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     self.transport._send(
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.19:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 05 18:31:35 devstack cinder-volume[86428]: ERROR oslo_messaging.rpc.server 
Nov 05 18:31:38 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Acquiring lock "singleton_lock" {{(pid=86428) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 18:31:38 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Acquired lock "singleton_lock" {{(pid=86428) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 18:31:38 devstack cinder-volume[86428]: DEBUG oslo_concurrency.lockutils [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Releasing lock "singleton_lock" {{(pid=86428) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 18:31:38 devstack cinder-volume[86428]: WARNING amqp [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 18:31:38 devstack cinder-volume[86428]: WARNING amqp [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 18:31:38 devstack cinder-volume[86211]: INFO oslo_service.backend._eventlet.service [None req-ad099c31-1e6d-411b-a545-ad7ee3c9b3cf None None] Child 86428 exited with status 0
Nov 05 18:31:39 devstack cinder-volume[86786]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 18:31:39 devstack cinder-volume[86786]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 18:31:39 devstack cinder-volume[86786]: we strongly recommend against using it for new projects.
Nov 05 18:31:39 devstack cinder-volume[86786]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 18:31:39 devstack cinder-volume[86786]: framework.  For more detail see
Nov 05 18:31:39 devstack cinder-volume[86786]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 18:31:39 devstack cinder-volume[86786]:   import eventlet  # noqa
Nov 05 18:31:42 devstack cinder-volume[86786]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 18:31:42 devstack cinder-volume[86786]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 18:31:42 devstack cinder-volume[86786]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 18:31:42 devstack cinder-volume[86786]: INFO dbcounter [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Registered counter for database cinder
Nov 05 18:31:42 devstack cinder-volume[86786]: DEBUG oslo_db.sqlalchemy.engines [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG dbcounter [-] [86786] Writer thread running {{(pid=86786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 18:31:43 devstack cinder-volume[86786]: INFO cinder.rpc [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 18:31:43 devstack cinder-volume[86786]: INFO cinder.rpc [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_db.sqlalchemy.engines [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:31:43 devstack cinder-volume[86786]: INFO cinder.volume.manager [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Determined volume DB was empty at startup.
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG cinder.volume.manager [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86786) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 18:31:43 devstack cinder-volume[86786]: WARNING stevedore.named [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 18:31:43 devstack cinder-volume[86786]: WARNING castellan.key_manager [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 18:31:43 devstack cinder-volume[86786]: WARNING cinder.keymgr.conf_key_mgr [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 18:31:43 devstack cinder-volume[86786]: INFO cinder.volume.manager [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_db.sqlalchemy.engines [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:31:43 devstack cinder-volume[86786]: INFO oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Starting 1 workers
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Started child 87086 {{(pid=86786) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Full set of CONF: {{(pid=86786) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] ******************************************************************************** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] Configuration options gathered from: {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] ================================================================================ {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] allow_availability_zone_fallback = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] allow_compression_on_image_upload = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] allowed_direct_url_schemes     = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] api_rate_limit                 = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] auth_strategy                  = keystone {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_availability_zone      = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_host                   = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_name                   = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_stats_polling_interval = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backup_api_class               = cinder.backup.api.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backup_name_template           = backup-%s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backup_use_same_host           = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backup_use_temp_snapshot       = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] chap_password                  = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] chap_username                  =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cinder_internal_tenant_project_id = 07ed71ffd8c64ee3b9c3f3f074d1f33a {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cinder_internal_tenant_user_id = 86ae8998bd5a445e81d15ce6866f5b9c {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cluster                        = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[87086]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] compression_format             = gzip {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] compute_api_class              = cinder.compute.nova.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] config_dir                     = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] config_source                  = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] control_exchange               = openstack {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] debug                          = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] default_availability_zone      = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] default_group_type             = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] default_volume_type            = QuobyteHD {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] disk_geometry                  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] driver_client_cert             = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] driver_client_cert_key         = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] driver_data_namespace          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] driver_ssl_cert_path           = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] driver_ssl_cert_verify         = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] driver_use_ssl                 = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] enable_new_services            = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] enable_unsupported_driver      = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] enabled_backends               = ['QuobyteHD'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] enforce_multipath_for_image_xfer = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] filter_function                = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance_api_insecure            = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance_api_servers             = ['http://192.168.122.19/image'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance_api_ssl_compression     = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance_ca_certificates_file    = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance_catalog_info            = image:glance:publicURL {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance_certfile                = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance_keyfile                 = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance_num_retries             = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance_request_timeout         = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] goodness_function              = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] graceful_shutdown_timeout      = 5 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] group_api_class                = cinder.group.api.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] host                           = devstack {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_compress_on_upload       = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_conversion_address_space_limit = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_conversion_cpu_limit     = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_conversion_disable       = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_introspection_address_space_limit = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_introspection_cpu_limit  = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_upload_use_cinder_backend = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_upload_use_internal_tenant = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_volume_cache_enabled     = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_volume_cache_max_count   = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] image_volume_cache_max_size_gb = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] init_host_max_objects_retrieval = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] instance_format                = [instance: %(uuid)s]  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] iscsi_target_flags             =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] iscsi_write_cache              = on {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] iser_helper                    = tgtadm {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] iser_ip_address                = 192.168.122.19 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] iser_port                      = 3260 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] log_color                      = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] log_config_append              = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] log_dir                        = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] log_file                       = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] log_options                    = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] log_rotate_interval            = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] log_rotate_interval_type       = days {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] log_rotation_type              = none {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] max_age                        = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] max_logfile_count              = 30 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] max_logfile_size_mb            = 200 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] max_over_subscription_ratio    = 20.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] message_reap_interval          = 86400 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] message_ttl                    = 2592000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] migration_create_volume_timeout_secs = 300 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] monkey_patch                   = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] monkey_patch_modules           = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] my_ip                          = 192.168.122.19 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] no_snapshot_gb_quota           = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] num_iser_scan_tries            = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] num_shell_tries                = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] num_volume_device_scan_tries   = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] nvmeof_conn_info_version       = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] nvmet_ns_id                    = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] nvmet_port_id                  = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] osapi_max_limit                = 1000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] osapi_volume_ext_list          = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] osapi_volume_listen_port       = 8776 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] osapi_volume_use_ssl           = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] osapi_volume_workers           = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] per_volume_size_limit          = -1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] periodic_fuzzy_delay           = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] periodic_interval              = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] public_endpoint                = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] publish_errors                 = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] quota_backup_gigabytes         = 1000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] quota_backups                  = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] quota_gigabytes                = 1000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] quota_groups                   = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] quota_snapshots                = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] quota_volumes                  = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] rate_limit_burst               = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] rate_limit_except_level        = CRITICAL {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] rate_limit_interval            = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] reinit_driver_count            = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] replication_device             = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] report_discard_supported       = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] report_interval                = 120 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] reservation_clean_interval     = 86400 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] reservation_expire             = 86400 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] reserved_image_namespaces      = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] reserved_percentage            = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] rpc_response_timeout           = 120 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] run_external_periodic_tasks    = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] scst_target_driver             = iscsi {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] scst_target_iqn_name           = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_down_time              = 720 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] shell_completion               = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] snapshot_name_template         = snapshot-%s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] split_loggers                  = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] state_path                     = /opt/stack/data/cinder {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] storage_availability_zone      = nova {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] storage_protocol               = iSCSI {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] syslog_log_facility            = LOG_USER {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] target_helper                  = lioadm {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] target_ip_address              = 192.168.122.19 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] target_port                    = 3260 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] target_protocol                = iscsi {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] target_secondary_ip_addresses  = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] trace_flags                    = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] transport_url                  = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] until_refresh                  = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] use_chap_auth                  = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] use_default_quota_class        = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] use_journal                    = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] use_json                       = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] use_multipath_for_image_xfer   = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] use_stderr                     = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] use_syslog                     = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] verify_glance_signatures       = enabled {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_api_class               = cinder.volume.api.API {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_backend_name            = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_clear                   = zero {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_clear_ionice            = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_clear_size              = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_copy_bps_limit          = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_dd_blocksize            = 1M {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_name_template           = volume-%s {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_service_inithost_offload = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volume_usage_audit_period      = month {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] zoning_mode                    = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_concurrency.disable_process_locking = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.auth_section = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.auth_type   = password {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.auth_version = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.cache       = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.certfile    = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.include_service_catalog = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87086) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.insecure    = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.interface   = public {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.keyfile     = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_password = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcache_username = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.region_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.service_type = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.19/identity {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.backend                  = dogpile.cache.null {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.backend_argument         = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.backend_expiration_time  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.config_prefix            = cache.oslo {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.debug_cache_backend      = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.enable_retry_client      = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.enable_socket_keepalive  = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.enabled                  = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.expiration_time          = 600 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.hashclient_retry_attempts = 2 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.memcache_dead_retry      = 300 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.memcache_pool_maxsize    = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.memcache_sasl_enabled    = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.password                 = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.proxies                  = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.redis_db                 = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.redis_server             = localhost:6379 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.retry_attempts           = 2 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.retry_delay              = 0.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.socket_keepalive_count   = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.socket_keepalive_idle    = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.socket_keepalive_interval = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.socket_timeout           = 1.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.tls_allowed_ciphers      = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.tls_cafile               = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.tls_certfile             = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.tls_enabled              = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.tls_keyfile              = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cache.username                 = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] coordination.backend_url       = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.asyncio_connection    = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.asyncio_slave_connection = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.backend               = sqlalchemy {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.connection            = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.connection_debug      = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.connection_parameters =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.connection_recycle_time = 3600 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.connection_trace      = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.db_inc_retry_interval = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.db_max_retries        = 20 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.db_max_retry_interval = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.db_retry_interval     = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.max_overflow          = 50 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.max_pool_size         = 5 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.max_retries           = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.mysql_wsrep_sync_wait = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.pool_timeout          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.retry_interval        = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.slave_connection      = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.sqlite_synchronous    = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.synchronous_reader    = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] database.use_db_reconnect      = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_tracing.insecure = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87086) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 18:31:43 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.quobyte [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 18:31:43 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.quobyte [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Running cmd (subprocess): mount.quobyte {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.connection_string     = messaging:// {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.enabled               = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.es_doc_type           = notification {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.es_scroll_size        = 10000 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.es_scroll_time        = 2m {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.filter_error_trace    = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.hmac_keys             = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.sentinel_service_name = mymaster {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.socket_timeout        = 0.1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.trace_requests        = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler.trace_sqlalchemy      = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler_jaeger.process_tags   = {} {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler_jaeger.service_name_prefix = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] profiler_otlp.service_name_prefix = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_policy.enforce_new_defaults = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_policy.policy_default_rule = default {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_policy.policy_file        = policy.yaml {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] privsep_osbrick.group          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] privsep_osbrick.helper_command = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] privsep_osbrick.user           = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cinder_sys_admin.group         = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cinder_sys_admin.helper_command = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] cinder_sys_admin.user          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.auth_section      = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.auth_type         = password {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.cafile            = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.certfile          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.collect_timing    = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.insecure          = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.keyfile           = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.send_service_user_token = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.split_loggers     = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.timeout           = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.tls_ciphers       = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] service_user.tls_min_version   = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.auth_section            = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.auth_type               = password {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.certfile                = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.collect_timing          = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.insecure                = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.keyfile                 = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.region_name             = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.split_loggers           = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.timeout                 = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.tls_ciphers             = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] glance.tls_min_version         = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.backend_availability_zone = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.chap_password = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.chap_username =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.disk_geometry = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.driver_client_cert = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.driver_client_cert_key = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.driver_data_namespace = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.driver_use_ssl = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.extra_capabilities = {} {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.filter_function = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.goodness_function = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.iscsi_target_flags =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.iscsi_write_cache = on {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.iser_helper   = tgtadm {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.iser_ip_address = 192.168.122.19 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.iser_port     = 3260 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nas_host      =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nas_login     = admin {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nas_mount_options = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nas_password  = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nas_private_key =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nas_share_path =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.num_shell_tries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.quobyte_volume_url = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.replication_device = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.report_discard_supported = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.reserved_percentage = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.target_helper = tgtadm {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.target_ip_address = 192.168.122.19 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.target_port   = 3260 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.target_protocol = iscsi {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.trace_flags   = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.unique_fqdn_network = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.use_chap_auth = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.volume_backend_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.volume_clear  = zero {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.volume_clear_ionice = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.volume_clear_size = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack quobyte-client[87095]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 18:31:43 devstack quobyte-client[87095]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_reports.file_event_handler = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_reports.log_dir           = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.backend_availability_zone = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.backend_host         = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.chap_password        = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.chap_username        = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.chiscsi_conf         = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.disk_geometry        = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.driver_client_cert   = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.driver_data_namespace = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.driver_use_ssl       = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.extra_capabilities   = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.filter_function      = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.goodness_function    = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.iser_helper          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.iser_ip_address      = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.iser_port            = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.iser_target_prefix   = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nas_host             = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nas_login            = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nas_mount_options    = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nas_password         = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nas_private_key      = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nas_share_path       = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nas_ssh_port         = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.num_shell_tries      = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.nvmet_port_id        = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack sudo[87096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.replication_device   = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.report_discard_supported = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.reserved_percentage  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.scst_target_driver   = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.storage_protocol     = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.target_helper        = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.target_ip_address    = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.target_port          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.target_prefix        = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.target_protocol      = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.trace_flags          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.use_chap_auth        = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.volume_clear         = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.volume_clear_size    = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] QuobyteHD.volumes_dir          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.ssl      = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_notifications.driver = [] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_notifications.retry = -1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] key_manager.fixed_key          = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.barbican_api_version  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.barbican_endpoint     = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.barbican_endpoint_type = public {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.barbican_region_name  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.cafile                = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.certfile              = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.collect_timing        = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.insecure              = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.keyfile               = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.number_of_retries     = 60 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.retry_delay           = 1 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.send_service_user_token = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.split_loggers         = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.timeout               = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.tls_ciphers           = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.tls_min_version       = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.verify_ssl            = True {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican.verify_ssl_path       = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.auth_section = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.auth_type = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.cafile   = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.certfile = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.collect_timing = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.insecure = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.keyfile  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.split_loggers = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.timeout  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.tls_ciphers = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] barbican_service_user.tls_min_version = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.approle_role_id          = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.approle_secret_id        = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.auth_method              = approle {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.auth_path                = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.kv_mountpoint            = secret {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.kv_path                  = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.kv_version               = 2 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.namespace                = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.root_token_id            = **** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.ssl_ca_crt_file          = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.timeout                  = 60.0 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.token_file               = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.token_role               = None {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.use_ssl                  = False {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 18:31:43 devstack cinder-volume[86786]: DEBUG oslo_service.backend._eventlet.service [None req-2236759a-b065-4300-b88b-44b445d4b72b None None] ******************************************************************************** {{(pid=86786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 18:31:43 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.266s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:43 devstack cinder-volume[87086]: INFO cinder.volume.driver [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG cinder.volume.driver [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.441806793213, 'free_capacity_gb': 1773.441806793213, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87086) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_db.sqlalchemy.engines [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87086) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writer thread running {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG cinder.db.api [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Building query based on filter {{(pid=87086) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87086) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:31:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:43 devstack cinder-volume[87086]: INFO cinder.keymgr.migration [None req-b14430bc-4621-442f-a4b7-9b166274da8a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 18:31:43 devstack sudo[87113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:31:43 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:44 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.247s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:31:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Driver initialization completed successfully.
Nov 05 18:31:44 devstack cinder-volume[87086]: INFO cinder.manager [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Initiating service 3 cleanup
Nov 05 18:31:44 devstack cinder-volume[87086]: INFO cinder.manager [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Service 3 cleanup completed.
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG cinder.service [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Creating RPC server for service cinder-volume {{(pid=87086) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG cinder.service [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87086) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 18:31:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:31:44 devstack sudo[87127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:31:44 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:31:44 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root
Nov 05 18:31:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.244s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:31:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-70c86318-4a70-455e-bdb0-12254ff182ff None None] Driver post RPC initialization completed successfully.
Nov 05 18:31:53 devstack cinder-volume[86786]: DEBUG dbcounter [-] [86786] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:31:54 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:31:54 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=3 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:32:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:32:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 6 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:32:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Flow 'volume_create_manager' (4fbac421-2da2-4d72-b37d-80d9bb48abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39af9782-4b25-4340-b34b-42532a942192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39af9782-4b25-4340-b34b-42532a942192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-728533227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643f4b9e-5fdc-4863-81ef-bb5ef4de7294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceeae15a40d4062b9b0bc7ca68c5dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:16Z,use_quota=True,user_id='f89ed7e17a464506a6ddf209add7a02d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1694a751-f6ae-4404-a756-af21b546f1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1694a751-f6ae-4404-a756-af21b546f1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (346fd54a-0ec3-4f92-8466-eb16eb219817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (346fd54a-0ec3-4f92-8466-eb16eb219817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '643f4b9e-5fdc-4863-81ef-bb5ef4de7294', 'volume_name': 'volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3361194-111a-4017-a490-d7c91fb72f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3361194-111a-4017-a490-d7c91fb72f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77a236e-4165-42b2-a9e1-a8519fe8a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:16 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Volume 643f4b9e-5fdc-4863-81ef-bb5ef4de7294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294', 'volume_size': 1}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-728533227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643f4b9e-5fdc-4863-81ef-bb5ef4de7294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceeae15a40d4062b9b0bc7ca68c5dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:16Z,use_quota=True,user_id='f89ed7e17a464506a6ddf209add7a02d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Creating volume 643f4b9e-5fdc-4863-81ef-bb5ef4de7294 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:33:16 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:33:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:16 devstack sudo[88046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294 1073741824
Nov 05 18:33:16 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:17 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294 1073741824" returned: 0 in 1.257s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:17 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294
Nov 05 18:33:17 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:18 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294" returned: 0 in 0.623s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:33:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f77a236e-4165-42b2-a9e1-a8519fe8a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb648ddf-1206-4daa-a582-6e59f37e22a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:18 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Volume volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294 (643f4b9e-5fdc-4863-81ef-bb5ef4de7294): created successfully
Nov 05 18:33:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb648ddf-1206-4daa-a582-6e59f37e22a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Flow 'volume_create_manager' (4fbac421-2da2-4d72-b37d-80d9bb48abff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:18 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-039110fb-455e-4a86-8b7c-0c4d78504b0d tempest-VolumesAdminNegativeTest-1883114352 None] Created volume successfully.
Nov 05 18:33:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a644f67a-dca0-440a-bcd1-b9df4addab78 tempest-BackendsCapabilitiesAdminTestsJSON-920902064 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.441806793213, 'free_capacity_gb': 1773.441806793213, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87086) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 18:33:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8df99f4a-716a-479a-8df6-dfcfab712eda tempest-BackendsCapabilitiesAdminTestsJSON-920902064 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.441806793213, 'free_capacity_gb': 1773.441806793213, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87086) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 18:33:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Acquiring lock "cinder-643f4b9e-5fdc-4863-81ef-bb5ef4de7294-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:33:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Lock "cinder-643f4b9e-5fdc-4863-81ef-bb5ef4de7294-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:33:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Acquiring lock "cinder-quobyte-643f4b9e-5fdc-4863-81ef-bb5ef4de7294" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:33:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Lock "cinder-quobyte-643f4b9e-5fdc-4863-81ef-bb5ef4de7294" acquired by "delete_volume" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:33:20 devstack cinder-volume[87086]: INFO oslo.privsep.daemon [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp04wspgmi/privsep.sock']
Nov 05 18:33:20 devstack sudo[88396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp04wspgmi/privsep.sock
Nov 05 18:33:20 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:21 devstack cinder-volume[87086]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 05 18:33:21 devstack cinder-volume[87086]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 18:33:21 devstack cinder-volume[87086]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 05 18:33:21 devstack cinder-volume[87086]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 18:33:21 devstack cinder-volume[87086]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 05 18:33:21 devstack cinder-volume[87086]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 05 18:33:21 devstack cinder-volume[87086]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 18:33:21 devstack cinder-volume[87086]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 18:33:21 devstack cinder-volume[87086]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 05 18:33:22 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:22 devstack cinder-volume[87086]: INFO oslo.privsep.daemon [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Spawned new privsep daemon via rootwrap
Nov 05 18:33:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Accepted privsep connection to /tmp/tmp04wspgmi/privsep.sock {{(pid=87086) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 05 18:33:22 devstack cinder-volume[87086]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 05 18:33:22 devstack cinder-volume[87086]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 05 18:33:22 devstack cinder-volume[87086]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 05 18:33:22 devstack cinder-volume[87086]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88401
Nov 05 18:33:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53060e3-f690-4c95-afdf-fc73653c684e]: (2,) {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:33:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50ae4e8-eafb-421d-8624-19ffebc0c715]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:33:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:22 devstack sudo[88403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294
Nov 05 18:33:22 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:22 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294" returned: 0 in 0.704s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:23 devstack sudo[88408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294
Nov 05 18:33:23 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Flow 'volume_create_manager' (22201955-eeef-4303-a533-4f3bcf581691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf79042d-f4a8-4fbd-938c-248ff97d3a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf79042d-f4a8-4fbd-938c-248ff97d3a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1772772658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c198618b-a58c-4341-8245-fbea3ebce4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de938c527c5648339e3e1c7a8e09b4b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:23Z,use_quota=True,user_id='0062a49ff484417db970b6ea95f5a755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62aa2ffc-9b62-4958-855e-239bcb127ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62aa2ffc-9b62-4958-855e-239bcb127ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00882ce-cc3b-48eb-8bb9-d6d03192acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00882ce-cc3b-48eb-8bb9-d6d03192acd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c198618b-a58c-4341-8245-fbea3ebce4be', 'volume_name': 'volume-c198618b-a58c-4341-8245-fbea3ebce4be', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c50a525-8c21-4eca-b3c8-d3f7e9f79d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c50a525-8c21-4eca-b3c8-d3f7e9f79d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe552b9-e122-4165-bd28-2af1a420c376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Volume c198618b-a58c-4341-8245-fbea3ebce4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c198618b-a58c-4341-8245-fbea3ebce4be', 'volume_size': 1}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1772772658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c198618b-a58c-4341-8245-fbea3ebce4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de938c527c5648339e3e1c7a8e09b4b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:23Z,use_quota=True,user_id='0062a49ff484417db970b6ea95f5a755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Creating volume c198618b-a58c-4341-8245-fbea3ebce4be {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:33:23 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:23 devstack sudo[88411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be 1073741824
Nov 05 18:33:23 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:23 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-643f4b9e-5fdc-4863-81ef-bb5ef4de7294" returned: 0 in 0.532s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Lock "cinder-quobyte-643f4b9e-5fdc-4863-81ef-bb5ef4de7294" released by "delete_volume" :: held 3.419s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Flow 'volume_create_manager' (8ca00a1f-c37b-49ea-8e14-dc0381895158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4c42d5-30ba-4b0f-9ba2-c4776cda2ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4c42d5-30ba-4b0f-9ba2-c4776cda2ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1725109273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049c059d-861c-4cfa-bdd2-bbb5ff677cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7687c06bc5401199ba5d828306acc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:24Z,use_quota=True,user_id='6ee9fb2405a54ae09f64feba7b6c6cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093792fa-02c9-4092-b307-bbd6969f2a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093792fa-02c9-4092-b307-bbd6969f2a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28208cb4-bfe6-454f-8ce3-72487bc07b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28208cb4-bfe6-454f-8ce3-72487bc07b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049c059d-861c-4cfa-bdd2-bbb5ff677cc1', 'volume_name': 'volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1460b753-7614-451b-bd06-6db280c5900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1460b753-7614-451b-bd06-6db280c5900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab05eec-d13b-473a-a064-47135936c003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Volume 049c059d-861c-4cfa-bdd2-bbb5ff677cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1', 'volume_size': 1}
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:23 devstack cinder-volume[87086]: WARNING cinder.quota [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:33:23 devstack cinder-volume[87086]: WARNING cinder.quota [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:33:23 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Created reservations ['cabfb88f-b3ae-46f7-9d50-bf0eb76d7b5c', '598d0a13-14a2-4b74-af19-014be759f36e', '4157a310-e5c3-4e78-bb7e-6be6baf85a50', 'b976608b-2d56-46b7-bef0-2ea5f96735b2'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:33:24 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be 1073741824" returned: 0 in 0.709s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:24 devstack sudo[88419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:33:24 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:24 devstack sudo[88420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be
Nov 05 18:33:24 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:24 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be" returned: 0 in 0.460s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.872s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1725109273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049c059d-861c-4cfa-bdd2-bbb5ff677cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7687c06bc5401199ba5d828306acc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:24Z,use_quota=True,user_id='6ee9fb2405a54ae09f64feba7b6c6cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Creating volume 049c059d-861c-4cfa-bdd2-bbb5ff677cc1 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:33:24 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:33:24 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.553s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:33:24 devstack sudo[88426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1 1073741824
Nov 05 18:33:24 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe552b9-e122-4165-bd28-2af1a420c376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c198618b-a58c-4341-8245-fbea3ebce4be', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6436c04-1ff4-4c0f-a082-474f49a42821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Deleted volume successfully.
Nov 05 18:33:24 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Volume volume-c198618b-a58c-4341-8245-fbea3ebce4be (c198618b-a58c-4341-8245-fbea3ebce4be): created successfully
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6436c04-1ff4-4c0f-a082-474f49a42821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Flow 'volume_create_manager' (22201955-eeef-4303-a533-4f3bcf581691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-80c8cf7b-b991-4733-90a7-feaaf57a904a tempest-VolumesAdminNegativeTest-1883114352 None] Lock "cinder-643f4b9e-5fdc-4863-81ef-bb5ef4de7294-delete_volume" released by "delete_volume" :: held 4.862s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:33:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e1ce672f-6217-4589-b405-4100a2f5521b tempest-ServersNegativeTestJSON-1219367790 None] Created volume successfully.
Nov 05 18:33:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:33:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:25 devstack sudo[88432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:33:25 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:25 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1 1073741824" returned: 0 in 0.924s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:25 devstack sudo[88435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1
Nov 05 18:33:25 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:26 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.453s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 8 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:33:26 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1" returned: 0 in 0.748s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab05eec-d13b-473a-a064-47135936c003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7ea22e-9be4-43a2-8aac-d611f422add3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:26 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Volume volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1 (049c059d-861c-4cfa-bdd2-bbb5ff677cc1): created successfully
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7ea22e-9be4-43a2-8aac-d611f422add3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Flow 'volume_create_manager' (8ca00a1f-c37b-49ea-8e14-dc0381895158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5ebf2fc5-299e-4a69-be77-6c8f8090c546 tempest-ServerActionsTestOtherA-931331433 None] Created volume successfully.
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Flow 'volume_create_manager' (3f4dab66-d721-48a8-a9fe-01b40a997a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4b0cbc-a52b-49e4-8f27-3a602b7b5ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4b0cbc-a52b-49e4-8f27-3a602b7b5ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-619672831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3aa666-8ded-425f-ae14-c916ddd4288d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de938c527c5648339e3e1c7a8e09b4b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:28Z,use_quota=True,user_id='0062a49ff484417db970b6ea95f5a755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7584cdd-0593-46f7-a073-117d663201f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7584cdd-0593-46f7-a073-117d663201f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3e4b32-dbe7-4a44-8782-f252e032d057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3e4b32-dbe7-4a44-8782-f252e032d057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe3aa666-8ded-425f-ae14-c916ddd4288d', 'volume_name': 'volume-fe3aa666-8ded-425f-ae14-c916ddd4288d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f2d2fc-929a-47a8-a2c2-d2aeaa3c5db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f2d2fc-929a-47a8-a2c2-d2aeaa3c5db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5106886-fb0e-40c1-af27-a3051e121d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:28 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Volume fe3aa666-8ded-425f-ae14-c916ddd4288d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe3aa666-8ded-425f-ae14-c916ddd4288d', 'volume_size': 1}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-619672831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3aa666-8ded-425f-ae14-c916ddd4288d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de938c527c5648339e3e1c7a8e09b4b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:28Z,use_quota=True,user_id='0062a49ff484417db970b6ea95f5a755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Creating volume fe3aa666-8ded-425f-ae14-c916ddd4288d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:33:28 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:33:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:28 devstack sudo[88466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d 1073741824
Nov 05 18:33:28 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:29 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d 1073741824" returned: 0 in 0.594s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:29 devstack sudo[88476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d
Nov 05 18:33:29 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:29 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d" returned: 0 in 0.335s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:33:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5106886-fb0e-40c1-af27-a3051e121d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe3aa666-8ded-425f-ae14-c916ddd4288d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ef9315-3896-402a-9b2b-d6b1cad80e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:29 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Volume volume-fe3aa666-8ded-425f-ae14-c916ddd4288d (fe3aa666-8ded-425f-ae14-c916ddd4288d): created successfully
Nov 05 18:33:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10ef9315-3896-402a-9b2b-d6b1cad80e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Flow 'volume_create_manager' (3f4dab66-d721-48a8-a9fe-01b40a997a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8d266a18-4e82-4b3b-a42b-a9c662e916a0 tempest-ServersNegativeTestJSON-1219367790 None] Created volume successfully.
Nov 05 18:33:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Acquiring lock "cinder-fe3aa666-8ded-425f-ae14-c916ddd4288d-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:33:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Lock "cinder-fe3aa666-8ded-425f-ae14-c916ddd4288d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:33:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Acquiring lock "cinder-quobyte-fe3aa666-8ded-425f-ae14-c916ddd4288d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:33:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Lock "cinder-quobyte-fe3aa666-8ded-425f-ae14-c916ddd4288d" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:33:32 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f14d978-cc3e-4477-a7e7-ee208aeb9453]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:33:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:32 devstack sudo[88499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d
Nov 05 18:33:32 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:32 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d" returned: 0 in 0.495s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:32 devstack sudo[88504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d
Nov 05 18:33:32 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:32 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fe3aa666-8ded-425f-ae14-c916ddd4288d" returned: 0 in 0.304s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Lock "cinder-quobyte-fe3aa666-8ded-425f-ae14-c916ddd4288d" released by "delete_volume" :: held 0.878s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:33:32 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Created reservations ['e709facd-aae2-48a6-a62f-ab260e96088a', '3dd2083c-9b39-47c1-b644-81c381dcd6ba', 'e7377182-91cf-4f79-a06b-81a23aa58c93', '15bb0dbe-cdb6-488e-b3cd-64673297500e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:33 devstack sudo[88509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:33:33 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Acquiring lock "cinder-c198618b-a58c-4341-8245-fbea3ebce4be-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Lock "cinder-c198618b-a58c-4341-8245-fbea3ebce4be-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Acquiring lock "cinder-quobyte-c198618b-a58c-4341-8245-fbea3ebce4be" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Lock "cinder-quobyte-c198618b-a58c-4341-8245-fbea3ebce4be" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a1ad7a-9710-480e-a7f7-2454e93ffef9]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:33 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.295s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:33:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Deleted volume successfully.
Nov 05 18:33:33 devstack sudo[88511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be
Nov 05 18:33:33 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-98a7bead-cfbd-4d1e-8dae-ce91dff0aba5 tempest-ServersNegativeTestJSON-1219367790 None] Lock "cinder-fe3aa666-8ded-425f-ae14-c916ddd4288d-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:33:33 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be" returned: 0 in 0.404s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:33 devstack sudo[88517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be
Nov 05 18:33:33 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:34 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c198618b-a58c-4341-8245-fbea3ebce4be" returned: 0 in 0.359s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Lock "cinder-quobyte-c198618b-a58c-4341-8245-fbea3ebce4be" released by "delete_volume" :: held 0.823s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Created reservations ['775f2b0f-617a-4eab-af69-16573305a20e', '8d3532a5-71ff-4495-8214-18cdc3289dca', 'fe628c28-91b3-4a2c-af77-f8b680766c27', '0dc7da4b-1d6c-4bb5-bc04-d11a22c15e42'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:34 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:33:34 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:34 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.317s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:33:34 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Deleted volume successfully.
Nov 05 18:33:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f5c9e4f5-e61d-478e-86c1-1dead53780b3 tempest-ServersNegativeTestJSON-1219367790 None] Lock "cinder-c198618b-a58c-4341-8245-fbea3ebce4be-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Flow 'volume_create_manager' (f829c984-7373-497f-8391-60e8d178fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f05fdc-940a-461d-99e1-07b7cfe64210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f05fdc-940a-461d-99e1-07b7cfe64210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1164457478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e35e81-b3c5-4127-b8c0-5178b194ead3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0c5f31b9da41df8894c417d6ce0a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:43Z,use_quota=True,user_id='ae0e32b9ef2046e8bc52050b700afe56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee0d055-5b0d-451c-bf3d-ee4aeb05057b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee0d055-5b0d-451c-bf3d-ee4aeb05057b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ee6892-5a77-438f-9d67-eb8b9a893bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ee6892-5a77-438f-9d67-eb8b9a893bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e35e81-b3c5-4127-b8c0-5178b194ead3', 'volume_name': 'volume-37e35e81-b3c5-4127-b8c0-5178b194ead3', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfe5498-d258-414a-874e-f59e96c59f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfe5498-d258-414a-874e-f59e96c59f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5191e4f5-4446-4d26-876c-63e679ca8f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:42 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Volume 37e35e81-b3c5-4127-b8c0-5178b194ead3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e35e81-b3c5-4127-b8c0-5178b194ead3', 'volume_size': 1}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1164457478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e35e81-b3c5-4127-b8c0-5178b194ead3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0c5f31b9da41df8894c417d6ce0a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:43Z,use_quota=True,user_id='ae0e32b9ef2046e8bc52050b700afe56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Creating volume 37e35e81-b3c5-4127-b8c0-5178b194ead3 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:33:42 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:33:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:42 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3 1073741824
Nov 05 18:33:42 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:43 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3 1073741824" returned: 0 in 0.685s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:43 devstack sudo[88666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3
Nov 05 18:33:43 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:43 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3" returned: 0 in 0.333s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:33:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5191e4f5-4446-4d26-876c-63e679ca8f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e35e81-b3c5-4127-b8c0-5178b194ead3', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc06ab4-e509-4665-a557-af012d9b15a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:43 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Volume volume-37e35e81-b3c5-4127-b8c0-5178b194ead3 (37e35e81-b3c5-4127-b8c0-5178b194ead3): created successfully
Nov 05 18:33:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc06ab4-e509-4665-a557-af012d9b15a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Flow 'volume_create_manager' (f829c984-7373-497f-8391-60e8d178fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a28dd5a1-836d-4158-bf12-d42cb9f6f41e tempest-VolumesServicesTestJSON-1244286880 None] Created volume successfully.
Nov 05 18:33:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Acquiring lock "cinder-37e35e81-b3c5-4127-b8c0-5178b194ead3-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:33:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Lock "cinder-37e35e81-b3c5-4127-b8c0-5178b194ead3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:33:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Acquiring lock "cinder-quobyte-37e35e81-b3c5-4127-b8c0-5178b194ead3" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:33:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Lock "cinder-quobyte-37e35e81-b3c5-4127-b8c0-5178b194ead3" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:33:45 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc94d6b-00a6-4d24-be60-ea0c2f0cee33]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:33:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:45 devstack sudo[88678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3
Nov 05 18:33:45 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:45 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3" returned: 0 in 0.478s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:45 devstack sudo[88683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3
Nov 05 18:33:45 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:45 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e35e81-b3c5-4127-b8c0-5178b194ead3" returned: 0 in 0.326s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Lock "cinder-quobyte-37e35e81-b3c5-4127-b8c0-5178b194ead3" released by "delete_volume" :: held 0.861s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Created reservations ['3f740588-ea75-47e4-acf0-a59466bb0d6b', 'b15de8f7-28d5-46b2-b14e-a3f501136274', 'b0329fb1-2f66-4df8-83d0-d8a2071ead39', 'c6b69abf-34d6-474a-b766-3fb216501b9d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:46 devstack sudo[88686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:33:46 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:46 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.453s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:33:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Deleted volume successfully.
Nov 05 18:33:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-46f0ebde-448d-4cc2-b8f1-69a2036654cc tempest-VolumesServicesTestJSON-1244286880 None] Lock "cinder-37e35e81-b3c5-4127-b8c0-5178b194ead3-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Flow 'volume_create_manager' (09365873-3755-4894-9751-8301ba2846ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8eea452-e37f-42d9-90a0-75c360bcb296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8eea452-e37f-42d9-90a0-75c360bcb296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1860421943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ede168-19f2-42ac-84d4-5a9ca3dd8422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b559b28bffd246bbbc1ec6303b0ba5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:54Z,use_quota=True,user_id='c72693cc2dfc4096a9c3d65614196698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76078d5d-5d9f-4dde-a28b-1576da6b4eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76078d5d-5d9f-4dde-a28b-1576da6b4eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0b6201-447d-4630-8744-b472065c129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0b6201-447d-4630-8744-b472065c129e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ede168-19f2-42ac-84d4-5a9ca3dd8422', 'volume_name': 'volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d500d5b-2dc2-42d8-a56b-d89ba2382f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d500d5b-2dc2-42d8-a56b-d89ba2382f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f86af9-d51d-4a6b-8c9d-dff048364781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:55 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Volume f6ede168-19f2-42ac-84d4-5a9ca3dd8422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422', 'volume_size': 1}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1860421943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ede168-19f2-42ac-84d4-5a9ca3dd8422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b559b28bffd246bbbc1ec6303b0ba5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:33:54Z,use_quota=True,user_id='c72693cc2dfc4096a9c3d65614196698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Creating volume f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:33:55 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:55 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 1073741824
Nov 05 18:33:55 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:55 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 1073741824" returned: 0 in 0.488s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:55 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422
Nov 05 18:33:55 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:55 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f86af9-d51d-4a6b-8c9d-dff048364781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39844077-a43d-4600-a7f6-48648937b950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:33:55 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Volume volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 (f6ede168-19f2-42ac-84d4-5a9ca3dd8422): created successfully
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39844077-a43d-4600-a7f6-48648937b950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:33:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Flow 'volume_create_manager' (09365873-3755-4894-9751-8301ba2846ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:33:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fa439059-8a1f-413f-967d-cd4d0a8c6c78 tempest-VolumesDeleteCascade-2015503225 None] Created volume successfully.
Nov 05 18:33:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:33:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:33:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Creating offline snapshot 49461edc-477f-4f1c-938a-50e96add908c of volume f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:33:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d2d34b-a716-4df9-9de6-c5f0f35a1ac8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:33:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:58 devstack sudo[88731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422
Nov 05 18:33:58 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:58 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" returned: 0 in 0.367s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:58 devstack sudo[88736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c 1G
Nov 05 18:33:58 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:58 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c 1G" returned: 0 in 0.376s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:58 devstack sudo[88741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c
Nov 05 18:33:58 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:59 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c" returned: 0 in 0.310s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:33:59 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c is being set with open permissions: ugo+rw
Nov 05 18:33:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:33:59 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c
Nov 05 18:33:59 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:33:59 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Nov 05 18:33:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c" returned: 0 in 0.240s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:02 devstack sudo[88749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.info
Nov 05 18:34:02 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:02 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.info" returned: 0 in 0.424s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:02 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.info is being set with open permissions: ugo+rw
Nov 05 18:34:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:02 devstack sudo[88752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.info
Nov 05 18:34:02 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:02 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.info" returned: 0 in 0.284s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.099s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:03 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-77a2c9a0-552b-493e-9e3a-840f7b0694ed tempest-VolumesDeleteCascade-2015503225 None] Create snapshot completed successfully
Nov 05 18:34:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] Creating offline snapshot 5e2f0592-99a9-4780-8961-d01ce47ea49f of volume f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:34:04 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec005a1-1691-4dfb-a934-5da1257890cb]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:04 devstack sudo[88755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c
Nov 05 18:34:04 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:04 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c" returned: 0 in 0.588s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:34:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:04 devstack sudo[88762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f 1G
Nov 05 18:34:04 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:05 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f 1G" returned: 0 in 0.648s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:05 devstack sudo[88768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f
Nov 05 18:34:05 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:05 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f" returned: 0 in 0.371s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:05 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f is being set with open permissions: ugo+rw
Nov 05 18:34:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:05 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f
Nov 05 18:34:05 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:06 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f" returned: 0 in 0.309s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:06 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9cc19081-2da8-4cd1-9ab1-7324f3ace732 tempest-VolumesDeleteCascade-2015503225 None] Create snapshot completed successfully
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-f6ede168-19f2-42ac-84d4-5a9ca3dd8422-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-f6ede168-19f2-42ac-84d4-5a9ca3dd8422-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Performing cascade delete. {{(pid=87086) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-49461edc-477f-4f1c-938a-50e96add908c-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-49461edc-477f-4f1c-938a-50e96add908c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-49461edc-477f-4f1c-938a-50e96add908c" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-49461edc-477f-4f1c-938a-50e96add908c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Deleting offline snapshot 49461edc-477f-4f1c-938a-50e96add908c of volume f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] snapshot_file for this snap is: volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8b2768-8ef2-4ecb-9848-fce0a5c846ca]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:07 devstack sudo[88778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c
Nov 05 18:34:07 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:08 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c" returned: 0 in 0.453s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:34:08 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[313e591b-b3ac-4421-873b-a7d8bef712e5]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:08 devstack sudo[88785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422
Nov 05 18:34:08 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:08 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" returned: 0 in 0.465s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:08 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1815ac-ae76-4c82-bda1-ca6cbd592aad]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:08 devstack sudo[88790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f
Nov 05 18:34:08 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:09 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f" returned: 0 in 0.373s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:34:09 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef271a46-04fe-4c57-8b65-222187eb6701]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:09 devstack sudo[88796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c
Nov 05 18:34:09 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:09 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c" returned: 0 in 0.459s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:34:09 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6782126-8baf-435d-9f54-bb2e9ca15948]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:09 devstack sudo[88801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422
Nov 05 18:34:09 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:10 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" returned: 0 in 0.534s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:10 devstack sudo[88806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c
Nov 05 18:34:10 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:10 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c" returned: 0 in 0.487s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:10 devstack sudo[88811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c
Nov 05 18:34:10 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:10 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.49461edc-477f-4f1c-938a-50e96add908c" returned: 0 in 0.392s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f -F qcow2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:10 devstack sudo[88814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f -F qcow2
Nov 05 18:34:10 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:11 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f -F qcow2" returned: 0 in 0.403s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-49461edc-477f-4f1c-938a-50e96add908c" released by "_delete_snapshot" :: held 3.804s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" released by "delete_snapshot" :: held 3.843s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:11 devstack cinder-volume[87086]: WARNING cinder.quota [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Created reservations ['23e4eb7d-0718-41b9-be17-412ce1e23d7e', '1f2acb9f-7e96-4f7e-8519-c2957583dea9', '31e54e10-9c43-446b-8ffa-5808bee7a0d3', 'aea4eba0-6a4f-406d-84f7-14ce0214f405'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:34:11 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Delete snapshot completed successfully.
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-49461edc-477f-4f1c-938a-50e96add908c-delete_snapshot" released by "delete_snapshot" :: held 4.091s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-5e2f0592-99a9-4780-8961-d01ce47ea49f-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-5e2f0592-99a9-4780-8961-d01ce47ea49f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-5e2f0592-99a9-4780-8961-d01ce47ea49f" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-5e2f0592-99a9-4780-8961-d01ce47ea49f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Deleting offline snapshot 5e2f0592-99a9-4780-8961-d01ce47ea49f of volume f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] snapshot_file for this snap is: volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5f7421-e917-4c6a-b465-a63f890afeb7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:11 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f
Nov 05 18:34:11 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:12 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f" returned: 0 in 0.473s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:34:12 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9e74cc-87c7-4372-918c-802c416f823f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:12 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422
Nov 05 18:34:12 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:12 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" returned: 0 in 0.595s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:12 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f
Nov 05 18:34:12 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:13 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f" returned: 0 in 0.636s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:13 devstack sudo[88849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f
Nov 05 18:34:13 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:13 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422.5e2f0592-99a9-4780-8961-d01ce47ea49f" returned: 0 in 0.322s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-5e2f0592-99a9-4780-8961-d01ce47ea49f" released by "_delete_snapshot" :: held 2.229s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" released by "delete_snapshot" :: held 2.267s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Created reservations ['eed4ce34-6fb2-4673-b76c-d87a051bf3b7', '2609e447-d38e-4e3d-a1af-35ffb19b4833', '01e6fc3d-7f48-4ed9-96a2-49463480b603', '0e955472-bdbc-4b24-976c-07bb8205cd5c'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:34:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Delete snapshot completed successfully.
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-5e2f0592-99a9-4780-8961-d01ce47ea49f-delete_snapshot" released by "delete_snapshot" :: held 2.516s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Snapshots deleted, issuing volume delete {{(pid=87086) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" acquired by "delete_volume" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5952985c-26e0-4881-95ca-73d6c79a9a96]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:14 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422
Nov 05 18:34:14 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:14 devstack cinder-volume[87086]: WARNING py.warnings [req-f01a9d7b-b12a-480e-aceb-47530050d4d7 req-499849ec-711a-413d-87e1-1d336b632612 tempest-ServerActionsTestOtherA-931331433 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 05 18:34:14 devstack cinder-volume[87086]:   .first()
Nov 05 18:34:14 devstack cinder-volume[87086]: 
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=54,cinder:INSERT=17,cinder:UPDATE=55,cinder:DELETE=6 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=48,cinder:UPDATE=74,cinder:DELETE=6,cinder:INSERT=14 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-f01a9d7b-b12a-480e-aceb-47530050d4d7 req-499849ec-711a-413d-87e1-1d336b632612 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-f01a9d7b-b12a-480e-aceb-47530050d4d7 req-499849ec-711a-413d-87e1-1d336b632612 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-f01a9d7b-b12a-480e-aceb-47530050d4d7 req-499849ec-711a-413d-87e1-1d336b632612 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-f01a9d7b-b12a-480e-aceb-47530050d4d7 req-499849ec-711a-413d-87e1-1d336b632612 tempest-ServerActionsTestOtherA-931331433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '160eccb0-f1c7-4964-8f1a-c73619ec34de', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:34:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-f01a9d7b-b12a-480e-aceb-47530050d4d7 req-499849ec-711a-413d-87e1-1d336b632612 tempest-ServerActionsTestOtherA-931331433 None] attachment_update completed successfully.
Nov 05 18:34:14 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" returned: 0 in 0.670s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:14 devstack sudo[88873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422
Nov 05 18:34:14 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:15 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" returned: 0 in 0.415s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-f6ede168-19f2-42ac-84d4-5a9ca3dd8422" released by "delete_volume" :: held 1.208s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:15 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Created reservations ['2c8c445c-351d-4392-80d4-64a0ed2b5a23', '0e3e0f85-7883-49cb-9059-05a0788ff0ad', '8938c789-2684-4349-9fed-79b7d3826bad', '6742cb4a-b2a0-46f0-9485-d778e53c3cef'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:34:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:34:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:34:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:15 devstack sudo[88983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:34:15 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:16 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.494s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:16 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:34:16 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Deleted volume successfully.
Nov 05 18:34:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dad22bc4-c79b-4d95-ab1a-38e20dcf5a95 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-f6ede168-19f2-42ac-84d4-5a9ca3dd8422-delete_volume" released by "delete_volume" :: held 8.775s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:16 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Flow 'volume_create_manager' (72410fe7-f775-4eda-a775-42b630385c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27cdb43-e82f-4e2c-92c6-4a5bb913763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27cdb43-e82f-4e2c-92c6-4a5bb913763c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1856349556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc52c10-366f-474a-bdce-cc563dce99f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b559b28bffd246bbbc1ec6303b0ba5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:34:17Z,use_quota=True,user_id='c72693cc2dfc4096a9c3d65614196698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c907ca6e-da6a-4e06-937d-76e7f8a3bc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c907ca6e-da6a-4e06-937d-76e7f8a3bc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f948e5ed-badc-41d6-a702-1467813dc5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f948e5ed-badc-41d6-a702-1467813dc5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc52c10-366f-474a-bdce-cc563dce99f6', 'volume_name': 'volume-efc52c10-366f-474a-bdce-cc563dce99f6', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfefdae-bc34-4f72-bd9c-d6b7bf9a0512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfefdae-bc34-4f72-bd9c-d6b7bf9a0512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680ce6c7-1906-4045-8aaa-44c06d6bdd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:17 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Volume efc52c10-366f-474a-bdce-cc563dce99f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc52c10-366f-474a-bdce-cc563dce99f6', 'volume_size': 1}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1856349556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc52c10-366f-474a-bdce-cc563dce99f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b559b28bffd246bbbc1ec6303b0ba5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:34:17Z,use_quota=True,user_id='c72693cc2dfc4096a9c3d65614196698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Creating volume efc52c10-366f-474a-bdce-cc563dce99f6 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:34:17 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:17 devstack sudo[89316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 1073741824
Nov 05 18:34:17 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:17 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 1073741824" returned: 0 in 0.574s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:17 devstack sudo[89323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6
Nov 05 18:34:17 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:18 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6" returned: 0 in 0.326s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:34:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680ce6c7-1906-4045-8aaa-44c06d6bdd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc52c10-366f-474a-bdce-cc563dce99f6', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccf11b4-422a-4c4e-b1b5-93f59b771e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:18 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Volume volume-efc52c10-366f-474a-bdce-cc563dce99f6 (efc52c10-366f-474a-bdce-cc563dce99f6): created successfully
Nov 05 18:34:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ccf11b4-422a-4c4e-b1b5-93f59b771e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Flow 'volume_create_manager' (72410fe7-f775-4eda-a775-42b630385c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:34:18 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ddd579ab-9195-41df-aecd-82129b23c335 tempest-VolumesDeleteCascade-2015503225 None] Created volume successfully.
Nov 05 18:34:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Creating offline snapshot 20c87065-47ec-4516-86f0-9c792b7ebef5 of volume efc52c10-366f-474a-bdce-cc563dce99f6 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:34:19 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29346ee-6941-43fb-b781-c7e6d4161218]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:20 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6
Nov 05 18:34:20 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:20 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6" returned: 0 in 0.833s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:20 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 1G
Nov 05 18:34:20 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-71d55d6d-2561-4b49-b9cf-eee4ef367cb1 req-584cca25-b91e-4534-89fb-1c4544df5361 tempest-ServerActionsTestOtherA-931331433 None] Terminate volume connection completed successfully.
Nov 05 18:34:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-71d55d6d-2561-4b49-b9cf-eee4ef367cb1 req-584cca25-b91e-4534-89fb-1c4544df5361 tempest-ServerActionsTestOtherA-931331433 None] Deleting attachment 160eccb0-f1c7-4964-8f1a-c73619ec34de. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:34:21 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 1G" returned: 0 in 0.814s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc52c10-366f-474a-bdce-cc563dce99f6 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:21 devstack sudo[89453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc52c10-366f-474a-bdce-cc563dce99f6 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5
Nov 05 18:34:21 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:22 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efc52c10-366f-474a-bdce-cc563dce99f6 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5" returned: 0 in 1.017s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:22 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 is being set with open permissions: ugo+rw
Nov 05 18:34:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:22 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5
Nov 05 18:34:22 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-71d55d6d-2561-4b49-b9cf-eee4ef367cb1 req-f477801c-bc10-41bc-a663-546b8fb81a47 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:22 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5" returned: 0 in 0.429s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:23 devstack sudo[89498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.info
Nov 05 18:34:23 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:23 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.info" returned: 0 in 0.308s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:23 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.info is being set with open permissions: ugo+rw
Nov 05 18:34:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:23 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.info
Nov 05 18:34:23 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:23 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.info" returned: 0 in 0.539s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.110s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-71d55d6d-2561-4b49-b9cf-eee4ef367cb1 req-f477801c-bc10-41bc-a663-546b8fb81a47 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.976s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-71d55d6d-2561-4b49-b9cf-eee4ef367cb1 req-f477801c-bc10-41bc-a663-546b8fb81a47 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9ca4b881-8b57-476e-89c5-fc38f861d9c0 tempest-VolumesDeleteCascade-2015503225 None] Create snapshot completed successfully
Nov 05 18:34:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-71d55d6d-2561-4b49-b9cf-eee4ef367cb1 req-f477801c-bc10-41bc-a663-546b8fb81a47 tempest-ServerActionsTestOtherA-931331433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a8ddfcf-62ea-49b0-b295-a8b7316dec37', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:34:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-71d55d6d-2561-4b49-b9cf-eee4ef367cb1 req-f477801c-bc10-41bc-a663-546b8fb81a47 tempest-ServerActionsTestOtherA-931331433 None] attachment_update completed successfully.
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Flow 'volume_create_manager' (c360ef96-e93b-4a91-87b3-963c17eb6248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe90f16-5bd9-4933-aff1-394f90392305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe90f16-5bd9-4933-aff1-394f90392305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1773913900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907c92b6-ce3f-4267-aa15-0a242faf5667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ceed1d352146088f277ff1dbeed505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:34:25Z,use_quota=True,user_id='5d19d27f43bc4bdcbfefd4259d36c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd8d467-57b0-4878-8c6b-82c38644a860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd8d467-57b0-4878-8c6b-82c38644a860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635feea1-a216-4143-b5f8-002a9338b4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635feea1-a216-4143-b5f8-002a9338b4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907c92b6-ce3f-4267-aa15-0a242faf5667', 'volume_name': 'volume-907c92b6-ce3f-4267-aa15-0a242faf5667', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60382fe8-d536-4fb5-997f-71a991e66afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60382fe8-d536-4fb5-997f-71a991e66afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5dbb75-fa25-4e93-9da9-7940f5b764aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:25 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Volume 907c92b6-ce3f-4267-aa15-0a242faf5667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907c92b6-ce3f-4267-aa15-0a242faf5667', 'volume_size': 1}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1773913900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907c92b6-ce3f-4267-aa15-0a242faf5667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45ceed1d352146088f277ff1dbeed505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:34:25Z,use_quota=True,user_id='5d19d27f43bc4bdcbfefd4259d36c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Creating volume 907c92b6-ce3f-4267-aa15-0a242faf5667 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:34:25 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:34:25 devstack sudo[89525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667 1073741824
Nov 05 18:34:25 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:25 devstack sudo[89527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:34:25 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Flow 'volume_create_manager' (6a14ab01-0454-4bf1-b286-ee4c1595df73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35df207b-1b12-4597-a38b-f12d0162c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35df207b-1b12-4597-a38b-f12d0162c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-179618569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4843f6a3-4671-4a34-8e53-091edb420c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b559b28bffd246bbbc1ec6303b0ba5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20c87065-47ec-4516-86f0-9c792b7ebef5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:34:26Z,use_quota=True,user_id='c72693cc2dfc4096a9c3d65614196698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36097a8-9781-46f4-bc57-646d807b8736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36097a8-9781-46f4-bc57-646d807b8736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd010b2-4c59-40d4-9591-4cab23bbbb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd010b2-4c59-40d4-9591-4cab23bbbb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4843f6a3-4671-4a34-8e53-091edb420c1b', 'volume_name': 'volume-4843f6a3-4671-4a34-8e53-091edb420c1b', 'volume_size': 1, 'snapshot_id': '20c87065-47ec-4516-86f0-9c792b7ebef5'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3296670d-f9c5-4761-9cbf-663b54572809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3296670d-f9c5-4761-9cbf-663b54572809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2e2999-948f-4477-ad15-80ab144b3829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:25 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Volume 4843f6a3-4671-4a34-8e53-091edb420c1b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4843f6a3-4671-4a34-8e53-091edb420c1b', 'volume_size': 1, 'snapshot_id': '20c87065-47ec-4516-86f0-9c792b7ebef5'}
Nov 05 18:34:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:26 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.644s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:34:26 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:34:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 8 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:34:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:34:26 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667 1073741824" returned: 0 in 0.939s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:26 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667
Nov 05 18:34:26 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:27 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667" returned: 0 in 0.357s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.062s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-20c87065-47ec-4516-86f0-9c792b7ebef5-4843f6a3-4671-4a34-8e53-091edb420c1b" by "_create_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5dbb75-fa25-4e93-9da9-7940f5b764aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907c92b6-ce3f-4267-aa15-0a242faf5667', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc79530d-a6e2-413f-9430-ca063ec5ccc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-20c87065-47ec-4516-86f0-9c792b7ebef5-4843f6a3-4671-4a34-8e53-091edb420c1b" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Creating volume 4843f6a3-4671-4a34-8e53-091edb420c1b from snapshot 20c87065-47ec-4516-86f0-9c792b7ebef5 {{(pid=87086) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-4843f6a3-4671-4a34-8e53-091edb420c1b" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-4843f6a3-4671-4a34-8e53-091edb420c1b" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] snapshot: 20c87065-47ec-4516-86f0-9c792b7ebef5, volume: 4843f6a3-4671-4a34-8e53-091edb420c1b,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cc0a3b-7f0b-47c6-bba1-f0fda9bebf18]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:27 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Volume volume-907c92b6-ce3f-4267-aa15-0a242faf5667 (907c92b6-ce3f-4267-aa15-0a242faf5667): created successfully
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc79530d-a6e2-413f-9430-ca063ec5ccc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Flow 'volume_create_manager' (c360ef96-e93b-4a91-87b3-963c17eb6248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:34:27 devstack sudo[89659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5
Nov 05 18:34:27 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:28 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e581fc4a-bcc1-41a6-b40f-24502af97440 tempest-DeleteServersTestJSON-20750599 None] Created volume successfully.
Nov 05 18:34:28 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5" returned: 0 in 0.859s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efc52c10-366f-474a-bdce-cc563dce99f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:34:28 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c1b404-af8b-4be7-8f47-34e24a75be8f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:28 devstack sudo[90007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6
Nov 05 18:34:28 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:29 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6" returned: 0 in 0.847s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:34:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:34:29 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:34:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:29 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b
Nov 05 18:34:29 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-3e434b9f-6a3d-4ad0-8b4a-4e6007f45323 req-a14ff5f4-1357-4e1d-81ca-6882f7312a11 tempest-DeleteServersTestJSON-20750599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:43 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=19,cinder:INSERT=3,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:34:43 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=36,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:34:43 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b" returned: 0 in 14.897s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:43 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6, size 1024.00 MB, duration 14.90 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:34:43 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Converted 1024.00 MB image at 68.73 MB/s
Nov 05 18:34:43 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b is being set with open permissions: ugo+rw
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:44 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b
Nov 05 18:34:44 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:44 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b" returned: 0 in 0.522s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-4843f6a3-4671-4a34-8e53-091edb420c1b" released by "_copy_volume_from_snapshot" :: held 17.371s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-20c87065-47ec-4516-86f0-9c792b7ebef5-4843f6a3-4671-4a34-8e53-091edb420c1b" released by "_create_volume_from_snapshot" :: held 17.490s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.532s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-3e434b9f-6a3d-4ad0-8b4a-4e6007f45323 req-a14ff5f4-1357-4e1d-81ca-6882f7312a11 tempest-DeleteServersTestJSON-20750599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.778s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-3e434b9f-6a3d-4ad0-8b4a-4e6007f45323 req-a14ff5f4-1357-4e1d-81ca-6882f7312a11 tempest-DeleteServersTestJSON-20750599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2e2999-948f-4477-ad15-80ab144b3829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4843f6a3-4671-4a34-8e53-091edb420c1b', 'volume_size': 1, 'snapshot_id': '20c87065-47ec-4516-86f0-9c792b7ebef5'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e534ccf-7ebe-44fd-88ed-d49f52de37ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:34:44 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Volume volume-4843f6a3-4671-4a34-8e53-091edb420c1b (4843f6a3-4671-4a34-8e53-091edb420c1b): created successfully
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e534ccf-7ebe-44fd-88ed-d49f52de37ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Flow 'volume_create_manager' (6a14ab01-0454-4bf1-b286-ee4c1595df73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:34:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-3e434b9f-6a3d-4ad0-8b4a-4e6007f45323 req-a14ff5f4-1357-4e1d-81ca-6882f7312a11 tempest-DeleteServersTestJSON-20750599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-907c92b6-ce3f-4267-aa15-0a242faf5667', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c76f519-6c57-4f9b-a633-e96fb309f5bd', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:34:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f1c07d9d-7a83-45a2-9fca-584b77125a55 tempest-VolumesDeleteCascade-2015503225 None] Created volume successfully.
Nov 05 18:34:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-3e434b9f-6a3d-4ad0-8b4a-4e6007f45323 req-a14ff5f4-1357-4e1d-81ca-6882f7312a11 tempest-DeleteServersTestJSON-20750599 None] attachment_update completed successfully.
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-efc52c10-366f-474a-bdce-cc563dce99f6-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-efc52c10-366f-474a-bdce-cc563dce99f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Performing cascade delete. {{(pid=87086) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-20c87065-47ec-4516-86f0-9c792b7ebef5-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-20c87065-47ec-4516-86f0-9c792b7ebef5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-efc52c10-366f-474a-bdce-cc563dce99f6" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-efc52c10-366f-474a-bdce-cc563dce99f6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-20c87065-47ec-4516-86f0-9c792b7ebef5" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-20c87065-47ec-4516-86f0-9c792b7ebef5" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Deleting offline snapshot 20c87065-47ec-4516-86f0-9c792b7ebef5 of volume efc52c10-366f-474a-bdce-cc563dce99f6 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] snapshot_file for this snap is: volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[369dc1f2-b774-4f48-802e-6b1e71e24548]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:46 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5
Nov 05 18:34:46 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:46 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5" returned: 0 in 0.554s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efc52c10-366f-474a-bdce-cc563dce99f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ced2fba-39b8-4476-9671-4d093678a088]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:47 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6
Nov 05 18:34:47 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:48 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6" returned: 0 in 1.110s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:48 devstack sudo[90329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5
Nov 05 18:34:48 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:48 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5" returned: 0 in 0.570s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:48 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5
Nov 05 18:34:48 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:48 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-3df76e39-2f75-467d-8a3d-99d64bdc8570 req-a1ee0e12-49c9-441e-bd2b-5b64e7bb8ddf tempest-DeleteServersTestJSON-20750599 None] Terminate volume connection completed successfully.
Nov 05 18:34:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-3df76e39-2f75-467d-8a3d-99d64bdc8570 req-a1ee0e12-49c9-441e-bd2b-5b64e7bb8ddf tempest-DeleteServersTestJSON-20750599 None] Deleting attachment 4c76f519-6c57-4f9b-a633-e96fb309f5bd. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:34:49 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6.20c87065-47ec-4516-86f0-9c792b7ebef5" returned: 0 in 0.465s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-20c87065-47ec-4516-86f0-9c792b7ebef5" released by "_delete_snapshot" :: held 2.844s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-efc52c10-366f-474a-bdce-cc563dce99f6" released by "delete_snapshot" :: held 2.894s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Created reservations ['1fcd7295-3762-472d-b70c-309bf7879f12', '53db1238-aadf-432f-b7bc-7592d43c348e', '121c3a96-086a-4746-8bb4-1827c002c423', 'b049fc49-55f6-4373-8c49-151004e0c2e1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:34:49 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Delete snapshot completed successfully.
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-20c87065-47ec-4516-86f0-9c792b7ebef5-delete_snapshot" released by "delete_snapshot" :: held 3.106s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Snapshots deleted, issuing volume delete {{(pid=87086) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-efc52c10-366f-474a-bdce-cc563dce99f6" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-efc52c10-366f-474a-bdce-cc563dce99f6" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d905c7-00bc-4a8f-9349-7b1c0756363a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:49 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6
Nov 05 18:34:49 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:49 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:49 devstack sudo[90354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6
Nov 05 18:34:49 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:50 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-efc52c10-366f-474a-bdce-cc563dce99f6" returned: 0 in 0.312s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-efc52c10-366f-474a-bdce-cc563dce99f6" released by "delete_volume" :: held 0.834s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Acquiring lock "cinder-907c92b6-ce3f-4267-aa15-0a242faf5667-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Lock "cinder-907c92b6-ce3f-4267-aa15-0a242faf5667-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Acquiring lock "cinder-quobyte-907c92b6-ce3f-4267-aa15-0a242faf5667" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Created reservations ['602d87bc-ed8f-4c4e-9635-e2185cd1ff5a', '03f487ca-75f1-4cc4-a85a-224a066565f7', '969c4d34-cb57-4a4a-8289-70715a49168a', '0e1b2755-d2c5-46a2-9a0e-0fe55b9fcdb8'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Lock "cinder-quobyte-907c92b6-ce3f-4267-aa15-0a242faf5667" acquired by "delete_volume" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb1e30b-5b90-4e63-b4af-e78c45d4bfa3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:50 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:34:50 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:50 devstack sudo[90358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667
Nov 05 18:34:50 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:50 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:34:50 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Deleted volume successfully.
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-45828484-7eee-4c9c-9c62-64296519bf49 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-efc52c10-366f-474a-bdce-cc563dce99f6-delete_volume" released by "delete_volume" :: held 4.539s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:50 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667" returned: 0 in 0.400s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:50 devstack sudo[90367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667
Nov 05 18:34:50 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:50 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-907c92b6-ce3f-4267-aa15-0a242faf5667" returned: 0 in 0.297s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Lock "cinder-quobyte-907c92b6-ce3f-4267-aa15-0a242faf5667" released by "delete_volume" :: held 0.750s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-4843f6a3-4671-4a34-8e53-091edb420c1b-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-4843f6a3-4671-4a34-8e53-091edb420c1b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Created reservations ['36618a71-d520-4503-9f75-4a50c68dd935', '9827df13-3056-4f3e-97ca-9bc820878f4a', 'a4c75c1e-12e1-4ab2-a2a7-e6006e1132d7', 'e178a2c8-218f-4b9e-9fc2-137ad60994c8'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "cinder-quobyte-4843f6a3-4671-4a34-8e53-091edb420c1b" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-4843f6a3-4671-4a34-8e53-091edb420c1b" acquired by "delete_volume" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c78c95-4ef7-4fe1-8857-15b29768ef7c]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:51 devstack sudo[90385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:34:51 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:51 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b
Nov 05 18:34:51 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:51 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.276s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:34:51 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Deleted volume successfully.
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9a843b82-6ff1-4ea2-a7a2-4cb51246cce4 tempest-DeleteServersTestJSON-20750599 None] Lock "cinder-907c92b6-ce3f-4267-aa15-0a242faf5667-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:51 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b" returned: 0 in 0.417s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:51 devstack sudo[90392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b
Nov 05 18:34:51 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:51 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4843f6a3-4671-4a34-8e53-091edb420c1b" returned: 0 in 0.273s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-quobyte-4843f6a3-4671-4a34-8e53-091edb420c1b" released by "delete_volume" :: held 0.743s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Created reservations ['5fcb0bc7-5896-4755-bb4b-87a5d1109da8', '9307315a-68b7-4001-9243-3523bed74135', 'a6952001-070e-4353-b715-c876c42d93d2', 'e764b398-b2a1-4366-8b99-06cc5d983ce0'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:34:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:34:51 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:34:51 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:34:52 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Nov 05 18:34:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:34:52 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:34:52 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Deleted volume successfully.
Nov 05 18:34:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dd71fe2a-a4ef-43c4-8193-71e4384a8514 tempest-VolumesDeleteCascade-2015503225 None] Lock "cinder-4843f6a3-4671-4a34-8e53-091edb420c1b-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:00 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:35:00 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Flow 'volume_create_manager' (d07e0756-ee3b-4baf-b719-1868a3b2924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a46edb7-a10e-4deb-8763-74f79fe7f3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a46edb7-a10e-4deb-8763-74f79fe7f3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1771475675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565aacbf-4f74-4a90-bde4-5a4157fbd3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45062daf4af14b7187729ee380d07e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:01Z,use_quota=True,user_id='f8959b5e2fc147d5b95fe1d18042e9ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8616e0-fe27-4fe1-95fa-1368957990f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8616e0-fe27-4fe1-95fa-1368957990f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbfc555-9d0f-4665-813d-1c2f4d5e2641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbfc555-9d0f-4665-813d-1c2f4d5e2641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '565aacbf-4f74-4a90-bde4-5a4157fbd3c1', 'volume_name': 'volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328cb62b-579c-4f26-893c-19fe061b4e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328cb62b-579c-4f26-893c-19fe061b4e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16057b14-13bb-4c81-a846-e3ed444613ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:01 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Volume 565aacbf-4f74-4a90-bde4-5a4157fbd3c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1', 'volume_size': 1}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1771475675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565aacbf-4f74-4a90-bde4-5a4157fbd3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45062daf4af14b7187729ee380d07e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:01Z,use_quota=True,user_id='f8959b5e2fc147d5b95fe1d18042e9ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Creating volume 565aacbf-4f74-4a90-bde4-5a4157fbd3c1 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:35:01 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:01 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 1073741824
Nov 05 18:35:01 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:01 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 1073741824" returned: 0 in 0.550s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:01 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1
Nov 05 18:35:01 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:01 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1" returned: 0 in 0.277s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16057b14-13bb-4c81-a846-e3ed444613ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaba010f-3304-4bfd-a17c-0e435c8049b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:01 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Volume volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 (565aacbf-4f74-4a90-bde4-5a4157fbd3c1): created successfully
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaba010f-3304-4bfd-a17c-0e435c8049b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Flow 'volume_create_manager' (d07e0756-ee3b-4baf-b719-1868a3b2924b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:02 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-970df379-b21b-4cd3-a8bf-8bc6991bca5b tempest-VolumesCloneTest-1894757796 None] Created volume successfully.
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Flow 'volume_create_manager' (5c747d6a-b2d5-40c1-93c7-9d0d8aa07f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f146350-00d9-484e-b18b-410299058c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f146350-00d9-484e-b18b-410299058c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-657762797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8ac22c-b5d0-4582-beac-f43c7554deeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36aef0224ffc42c2a2ab959eb1c0193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:03Z,use_quota=True,user_id='fcf044385aa84e558a3f4f462e147eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca69aa8-3eb1-4840-9cff-54018722d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca69aa8-3eb1-4840-9cff-54018722d29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd07a0bf-0e2a-4fe9-9dc4-add4989057fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd07a0bf-0e2a-4fe9-9dc4-add4989057fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c8ac22c-b5d0-4582-beac-f43c7554deeb', 'volume_name': 'volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d5185e-66db-4e32-bf24-f6be394288ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d5185e-66db-4e32-bf24-f6be394288ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fc6818-d701-489a-ba78-4f5d0d818604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:03 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Volume 5c8ac22c-b5d0-4582-beac-f43c7554deeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb', 'volume_size': 1}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-657762797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c8ac22c-b5d0-4582-beac-f43c7554deeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36aef0224ffc42c2a2ab959eb1c0193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:03Z,use_quota=True,user_id='fcf044385aa84e558a3f4f462e147eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Creating volume 5c8ac22c-b5d0-4582-beac-f43c7554deeb {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:35:03 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:03 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb 1073741824
Nov 05 18:35:03 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Flow 'volume_create_manager' (8ffc6a94-c024-4b92-8415-13ad137f38a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2bd6dc-d8eb-4d75-9647-03fa825fde79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2bd6dc-d8eb-4d75-9647-03fa825fde79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1977753704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e466a9f-db59-4a81-8491-1b39d8726c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45062daf4af14b7187729ee380d07e51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=565aacbf-4f74-4a90-bde4-5a4157fbd3c1,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:04Z,use_quota=True,user_id='f8959b5e2fc147d5b95fe1d18042e9ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a887fd0-50e6-4f79-946a-32a292399a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a887fd0-50e6-4f79-946a-32a292399a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea11dc8-28d7-42ef-878f-33ae86a9e4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea11dc8-28d7-42ef-878f-33ae86a9e4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2e466a9f-db59-4a81-8491-1b39d8726c59', 'volume_name': 'volume-2e466a9f-db59-4a81-8491-1b39d8726c59', 'volume_size': 2, 'source_volid': '565aacbf-4f74-4a90-bde4-5a4157fbd3c1', 'source_volstatus': 'available'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39aac310-355c-497b-9018-52273d60aae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39aac310-355c-497b-9018-52273d60aae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbd9592-b39e-4229-84ca-be6b9442fbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:04 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Volume 2e466a9f-db59-4a81-8491-1b39d8726c59: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2e466a9f-db59-4a81-8491-1b39d8726c59', 'volume_size': 2, 'source_volid': '565aacbf-4f74-4a90-bde4-5a4157fbd3c1', 'source_volstatus': 'available'}
Nov 05 18:35:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-6683a959-3f05-4242-9808-40d92b24383f req-9310d4d1-2b6b-43b1-8bbe-6b7db181537c tempest-ServerActionsTestOtherA-931331433 None] Terminate volume connection completed successfully.
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-6683a959-3f05-4242-9808-40d92b24383f req-9310d4d1-2b6b-43b1-8bbe-6b7db181537c tempest-ServerActionsTestOtherA-931331433 None] Deleting attachment 7a8ddfcf-62ea-49b0-b295-a8b7316dec37. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:04 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb 1073741824" returned: 0 in 0.627s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:04 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb
Nov 05 18:35:04 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:04 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb" returned: 0 in 0.326s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.639s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:04 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Cloning volume 565aacbf-4f74-4a90-bde4-5a4157fbd3c1 to volume 2e466a9f-db59-4a81-8491-1b39d8726c59
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fc6818-d701-489a-ba78-4f5d0d818604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13284aa6-481d-4c02-8c91-114824fcff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:04 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Volume volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb (5c8ac22c-b5d0-4582-beac-f43c7554deeb): created successfully
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13284aa6-481d-4c02-8c91-114824fcff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Flow 'volume_create_manager' (5c747d6a-b2d5-40c1-93c7-9d0d8aa07f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Creating offline snapshot 8b20efbb-1711-40e2-8abd-1636a30fb317 of volume 565aacbf-4f74-4a90-bde4-5a4157fbd3c1 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:35:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-335041fd-14ac-41e2-8ceb-dc26085d11a6 tempest-AttachVolumeTestJSON-1909145057 None] Created volume successfully.
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1907d0e7-e3e0-4680-b495-501bde32825b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:05 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1
Nov 05 18:35:05 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:05 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1" returned: 0 in 0.554s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:05 devstack sudo[90458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 1G
Nov 05 18:35:05 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:06 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 1G" returned: 0 in 0.662s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:06 devstack sudo[90478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317
Nov 05 18:35:06 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:06 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317" returned: 0 in 0.423s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:06 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 is being set with open permissions: ugo+rw
Nov 05 18:35:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:06 devstack sudo[90484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317
Nov 05 18:35:06 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:06 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317" returned: 0 in 0.344s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:06 devstack sudo[90489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.info
Nov 05 18:35:06 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:07 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.info" returned: 0 in 0.423s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:07 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.info is being set with open permissions: ugo+rw
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-e2b64f46-e2df-44c2-a7c8-f71430194de5 req-6497d277-f4b6-42ea-af3d-35bfd66368b2 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:07 devstack sudo[90502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.info
Nov 05 18:35:07 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:07 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.info" returned: 0 in 0.310s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Acquiring lock "cinder-quobyte-2e466a9f-db59-4a81-8491-1b39d8726c59" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Lock "cinder-quobyte-2e466a9f-db59-4a81-8491-1b39d8726c59" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] snapshot: 8b20efbb-1711-40e2-8abd-1636a30fb317, volume: 2e466a9f-db59-4a81-8491-1b39d8726c59,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cf39c5-f841-42b8-9c80-33d5410d2c62]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:07 devstack sudo[90505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317
Nov 05 18:35:07 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:08 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317" returned: 0 in 0.683s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:35:08 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[149890c4-2cfd-4e27-88d5-37658f60515e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:08 devstack sudo[90513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1
Nov 05 18:35:08 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:08 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:35:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:35:08 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59 not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:35:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:08 devstack sudo[90518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59
Nov 05 18:35:08 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:14 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:35:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Flow 'volume_create_manager' (fb1693f3-3ec6-44f9-ba17-244252e198a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191c1e83-189b-4aeb-8f91-16601a74bcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191c1e83-189b-4aeb-8f91-16601a74bcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-143564873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051b836b-21ef-4379-bb51-72f5a2f7744b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7687c06bc5401199ba5d828306acc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:15Z,use_quota=True,user_id='6ee9fb2405a54ae09f64feba7b6c6cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b77651-1c2a-4e60-b426-b88448941f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b77651-1c2a-4e60-b426-b88448941f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96c6523-fc14-4916-85fd-6be11fc77cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:15 devstack cinder-volume[87086]: DEBUG cinder.image.glance [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Creating Keystone auth plugin from conf {{(pid=87086) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 18:35:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96c6523-fc14-4916-85fd-6be11fc77cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '051b836b-21ef-4379-bb51-72f5a2f7744b', 'volume_name': 'volume-051b836b-21ef-4379-bb51-72f5a2f7744b', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf47fcbc0>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605e7ba3-b7e8-4a83-b71a-fa6c151225cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605e7ba3-b7e8-4a83-b71a-fa6c151225cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e815056-1733-42c5-9dfc-e5a08a9e6edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:16 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Volume 051b836b-21ef-4379-bb51-72f5a2f7744b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-051b836b-21ef-4379-bb51-72f5a2f7744b', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf47fcbc0>}
Nov 05 18:35:16 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Trying to clone 051b836b-21ef-4379-bb51-72f5a2f7744b from image f12bcbef-da90-40ac-bcfe-4218bc9aa565 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]). {{(pid=87086) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 18:35:17 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 18:35:17 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 18:35:17 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa499d9e-2f5f-4f74-b1d7-3e6c04f312aa]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:17 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD
Nov 05 18:35:17 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:17 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:17 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Temporary image f12bcbef-da90-40ac-bcfe-4218bc9aa565 is fetched for user 6ee9fb2405a54ae09f64feba7b6c6cd3. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 18:35:17 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59" returned: 0 in 8.981s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:17 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:35:17 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Converted 1024.00 MB image at 114.00 MB/s
Nov 05 18:35:17 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59 is being set with open permissions: ugo+rw
Nov 05 18:35:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:17 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59
Nov 05 18:35:17 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:17 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffbc573-c233-4b4c-bdf1-a6fe697762a2]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:18 devstack sudo[90560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD
Nov 05 18:35:18 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:18 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59" returned: 0 in 0.290s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Lock "cinder-quobyte-2e466a9f-db59-4a81-8491-1b39d8726c59" released by "_copy_volume_from_snapshot" :: held 10.501s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Acquiring lock "cinder-quobyte-8b20efbb-1711-40e2-8abd-1636a30fb317" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Lock "cinder-quobyte-8b20efbb-1711-40e2-8abd-1636a30fb317" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Deleting offline snapshot 8b20efbb-1711-40e2-8abd-1636a30fb317 of volume 565aacbf-4f74-4a90-bde4-5a4157fbd3c1 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] snapshot_file for this snap is: volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf5f553-c7be-492d-8e76-9d1684c077a2]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:18 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:18 devstack sudo[90564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317
Nov 05 18:35:18 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:18 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317" returned: 0 in 0.412s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ce0c9-079d-4d90-afd6-c3bb1d2a56ed]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:18 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1
Nov 05 18:35:18 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:19 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1" returned: 0 in 0.546s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:19 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317
Nov 05 18:35:19 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:19 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317" returned: 0 in 0.403s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:19 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317
Nov 05 18:35:19 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:19 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1.8b20efbb-1711-40e2-8abd-1636a30fb317" returned: 0 in 0.257s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Lock "cinder-quobyte-8b20efbb-1711-40e2-8abd-1636a30fb317" released by "_delete_snapshot" :: held 1.730s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.282s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-e2b64f46-e2df-44c2-a7c8-f71430194de5 req-6497d277-f4b6-42ea-af3d-35bfd66368b2 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.638s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-e2b64f46-e2df-44c2-a7c8-f71430194de5 req-6497d277-f4b6-42ea-af3d-35bfd66368b2 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.694s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-143564873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051b836b-21ef-4379-bb51-72f5a2f7744b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb7687c06bc5401199ba5d828306acc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:15Z,use_quota=True,user_id='6ee9fb2405a54ae09f64feba7b6c6cd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Creating volume 051b836b-21ef-4379-bb51-72f5a2f7744b {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:35:20 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbd9592-b39e-4229-84ca-be6b9442fbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e466a9f-db59-4a81-8491-1b39d8726c59', 'volume_size': 2, 'source_volid': '565aacbf-4f74-4a90-bde4-5a4157fbd3c1', 'source_volstatus': 'available'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66daa84-6b41-480d-acf6-b680682d44d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:20 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b 1073741824
Nov 05 18:35:20 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:20 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Volume volume-2e466a9f-db59-4a81-8491-1b39d8726c59 (2e466a9f-db59-4a81-8491-1b39d8726c59): created successfully
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66daa84-6b41-480d-acf6-b680682d44d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Flow 'volume_create_manager' (8ffc6a94-c024-4b92-8415-13ad137f38a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-e2b64f46-e2df-44c2-a7c8-f71430194de5 req-6497d277-f4b6-42ea-af3d-35bfd66368b2 tempest-AttachVolumeTestJSON-1909145057 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5a1fa01-4730-41df-8250-cafa4cf4d8db', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:35:20 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fa29dd14-1018-47d1-949a-2dc35992a198 tempest-VolumesCloneTest-1894757796 None] Created volume successfully.
Nov 05 18:35:20 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-e2b64f46-e2df-44c2-a7c8-f71430194de5 req-6497d277-f4b6-42ea-af3d-35bfd66368b2 tempest-AttachVolumeTestJSON-1909145057 None] attachment_update completed successfully.
Nov 05 18:35:20 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b 1073741824" returned: 0 in 0.647s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:20 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b
Nov 05 18:35:20 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:21 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b" returned: 0 in 0.379s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Acquiring lock "cinder-2e466a9f-db59-4a81-8491-1b39d8726c59-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Attempting download of f12bcbef-da90-40ac-bcfe-4218bc9aa565 ((None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}])) to volume 051b836b-21ef-4379-bb51-72f5a2f7744b. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Lock "cinder-2e466a9f-db59-4a81-8491-1b39d8726c59-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Acquiring lock "cinder-quobyte-2e466a9f-db59-4a81-8491-1b39d8726c59" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Lock "cinder-quobyte-2e466a9f-db59-4a81-8491-1b39d8726c59" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8cbf82-2de6-41a3-94fe-622483e78495]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[61202701-3788-445b-928a-995641360e29]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_5doi6sk4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:21 devstack sudo[91010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59
Nov 05 18:35:21 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:21 devstack sudo[91011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_5doi6sk4
Nov 05 18:35:21 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:21 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59" returned: 0 in 0.428s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:21 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_5doi6sk4" returned: 0 in 0.428s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_5doi6sk4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:21 devstack sudo[91019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59
Nov 05 18:35:21 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:21 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_5doi6sk4
Nov 05 18:35:21 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:22 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e466a9f-db59-4a81-8491-1b39d8726c59" returned: 0 in 0.422s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Lock "cinder-quobyte-2e466a9f-db59-4a81-8491-1b39d8726c59" released by "delete_volume" :: held 0.934s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Created reservations ['ea14125b-806e-4933-a8bf-4eb46970277e', '6f7bd961-518f-4ad1-9d32-aa0028fafc20', 'a2a35c01-6c97-44d2-b5f8-1e6e53cebe16', '4b090873-9180-4acf-8c7b-68606877e059'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:35:22 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_5doi6sk4" returned: 1 in 0.577s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_5doi6sk4' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e03c11-c792-45ba-b32c-e88e104abe81]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:22 devstack sudo[91030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:35:22 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:22 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD
Nov 05 18:35:22 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Acquiring lock "cinder-565aacbf-4f74-4a90-bde4-5a4157fbd3c1-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Lock "cinder-565aacbf-4f74-4a90-bde4-5a4157fbd3c1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Acquiring lock "cinder-quobyte-565aacbf-4f74-4a90-bde4-5a4157fbd3c1" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Lock "cinder-quobyte-565aacbf-4f74-4a90-bde4-5a4157fbd3c1" acquired by "delete_volume" :: waited 0.047s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a51e4-1775-47b4-9a56-dbe00356a888]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:22 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.435s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:35:22 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Deleted volume successfully.
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fda81900-3f58-4e27-bcca-828b89691b3b tempest-VolumesCloneTest-1894757796 None] Lock "cinder-2e466a9f-db59-4a81-8491-1b39d8726c59-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:22 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD" returned: 0 in 0.641s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] f12bcbef-da90-40ac-bcfe-4218bc9aa565 was qcow2, converting to qcow2 {{(pid=87086) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 18:35:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:23 devstack sudo[91038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1
Nov 05 18:35:23 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:23 devstack sudo[91043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b
Nov 05 18:35:23 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:23 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1" returned: 0 in 0.456s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:23 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1
Nov 05 18:35:23 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:23 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-565aacbf-4f74-4a90-bde4-5a4157fbd3c1" returned: 0 in 0.297s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Lock "cinder-quobyte-565aacbf-4f74-4a90-bde4-5a4157fbd3c1" released by "delete_volume" :: held 0.872s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Created reservations ['2d95d29c-1a78-466c-9655-c6e25ae54929', '3a7f70a9-eb20-49a8-80ad-54a171bab12b', 'edaafa08-a123-41e1-b77c-9f6fc165d93c', 'ffce903c-e496-4fdd-a286-2a63d15b8123'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:23 devstack sudo[91058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:35:23 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:24 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.562s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:24 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:35:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Deleted volume successfully.
Nov 05 18:35:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d370e00f-a47c-4baa-b551-11a7b08a557a tempest-VolumesCloneTest-1894757796 None] Lock "cinder-565aacbf-4f74-4a90-bde4-5a4157fbd3c1-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:35:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:25 devstack sudo[91102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:35:25 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:25 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b" returned: 0 in 2.855s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:25 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_nsevz2g2devstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:35:25 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Converted 112.00 MB image at 39.16 MB/s
Nov 05 18:35:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:25 devstack sudo[91109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b 1G
Nov 05 18:35:25 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:26 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.460s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:35:26 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b 1G" returned: 0 in 0.663s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Downloaded image f12bcbef-da90-40ac-bcfe-4218bc9aa565 ((None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}])) to volume 051b836b-21ef-4379-bb51-72f5a2f7744b successfully. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Temporary image f12bcbef-da90-40ac-bcfe-4218bc9aa565 for user 6ee9fb2405a54ae09f64feba7b6c6cd3 is deleted. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Marking volume 051b836b-21ef-4379-bb51-72f5a2f7744b as bootable. {{(pid=87086) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Copying metadata from image f12bcbef-da90-40ac-bcfe-4218bc9aa565 to 051b836b-21ef-4379-bb51-72f5a2f7744b. {{(pid=87086) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Creating volume glance metadata for volume 051b836b-21ef-4379-bb51-72f5a2f7744b backed by image f12bcbef-da90-40ac-bcfe-4218bc9aa565 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87086) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e815056-1733-42c5-9dfc-e5a08a9e6edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051b836b-21ef-4379-bb51-72f5a2f7744b', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf47fcbc0>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21629d5-40c5-46ef-8b9f-6c186498ba99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:26 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Volume volume-051b836b-21ef-4379-bb51-72f5a2f7744b (051b836b-21ef-4379-bb51-72f5a2f7744b): created successfully
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21629d5-40c5-46ef-8b9f-6c186498ba99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Flow 'volume_create_manager' (fb1693f3-3ec6-44f9-ba17-244252e198a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c4449920-fd05-444b-b867-54013b104566 tempest-ServerActionsTestOtherA-931331433 None] Created volume successfully.
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Flow 'volume_create_manager' (483a1352-aeed-459a-b482-35239652826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1101e4-9122-4f86-8b22-4354c007e191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1101e4-9122-4f86-8b22-4354c007e191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1895669409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e07af39-318f-487f-886c-9da0ca87a646,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8c48f2c16f804de5ae667a2e7b086312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:31Z,use_quota=True,user_id='3e5b0edf834345f5bb7c41311ba991a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42aaa557-91be-4f5b-9126-8a893f073d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42aaa557-91be-4f5b-9126-8a893f073d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9427d421-e982-4eb9-8ff5-a94a87611ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9427d421-e982-4eb9-8ff5-a94a87611ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e07af39-318f-487f-886c-9da0ca87a646', 'volume_name': 'volume-4e07af39-318f-487f-886c-9da0ca87a646', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ec7788-3116-404f-a281-fa9fadc5b08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ec7788-3116-404f-a281-fa9fadc5b08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f4cdaa-3205-4100-8358-ca24c6ee7780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:31 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Volume 4e07af39-318f-487f-886c-9da0ca87a646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e07af39-318f-487f-886c-9da0ca87a646', 'volume_size': 1}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1895669409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e07af39-318f-487f-886c-9da0ca87a646,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8c48f2c16f804de5ae667a2e7b086312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:31Z,use_quota=True,user_id='3e5b0edf834345f5bb7c41311ba991a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Creating volume 4e07af39-318f-487f-886c-9da0ca87a646 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:35:31 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:31 devstack sudo[91615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646 1073741824
Nov 05 18:35:31 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-3036e989-3ed0-4f0c-a0a3-d27bab9e1b36 req-1502ce6e-7b91-4a11-b293-95fb51337876 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:32 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646 1073741824" returned: 0 in 0.883s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:32 devstack sudo[91629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646
Nov 05 18:35:32 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:32 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646" returned: 0 in 0.317s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-3036e989-3ed0-4f0c-a0a3-d27bab9e1b36 req-1502ce6e-7b91-4a11-b293-95fb51337876 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.655s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-3036e989-3ed0-4f0c-a0a3-d27bab9e1b36 req-1502ce6e-7b91-4a11-b293-95fb51337876 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f4cdaa-3205-4100-8358-ca24c6ee7780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e07af39-318f-487f-886c-9da0ca87a646', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cdf60d-715f-421b-9efc-b733dd4d940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:32 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Volume volume-4e07af39-318f-487f-886c-9da0ca87a646 (4e07af39-318f-487f-886c-9da0ca87a646): created successfully
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5cdf60d-715f-421b-9efc-b733dd4d940b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Flow 'volume_create_manager' (483a1352-aeed-459a-b482-35239652826a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-4d4e8848-9a09-4a00-8a92-2eb661dc913d tempest-VolumesListTestJSON-1470049589 None] Created volume successfully.
Nov 05 18:35:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-3036e989-3ed0-4f0c-a0a3-d27bab9e1b36 req-1502ce6e-7b91-4a11-b293-95fb51337876 tempest-ServerActionsTestOtherA-931331433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-051b836b-21ef-4379-bb51-72f5a2f7744b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2da902bf-3ebb-4628-b690-e9d41d3050dd', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:35:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-3036e989-3ed0-4f0c-a0a3-d27bab9e1b36 req-1502ce6e-7b91-4a11-b293-95fb51337876 tempest-ServerActionsTestOtherA-931331433 None] attachment_update completed successfully.
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Flow 'volume_create_manager' (bb2f04e8-f3c3-494d-b6e0-14ea33b82041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea33aba3-6a62-44c8-bdf3-37ed39e20828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea33aba3-6a62-44c8-bdf3-37ed39e20828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-698057816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0597d45d-b1b6-4563-ade4-92e2de7552a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8c48f2c16f804de5ae667a2e7b086312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:34Z,use_quota=True,user_id='3e5b0edf834345f5bb7c41311ba991a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f47a65-8ab7-4071-9e61-8f761e1329ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f47a65-8ab7-4071-9e61-8f761e1329ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96b5eb9-9834-4347-874a-b30eb7c0a0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96b5eb9-9834-4347-874a-b30eb7c0a0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0597d45d-b1b6-4563-ade4-92e2de7552a1', 'volume_name': 'volume-0597d45d-b1b6-4563-ade4-92e2de7552a1', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743bcfcd-ad20-4027-8249-ff9cf04a6b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743bcfcd-ad20-4027-8249-ff9cf04a6b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83eed4a5-f0c3-4d58-a974-8c704afbfd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:34 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Volume 0597d45d-b1b6-4563-ade4-92e2de7552a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0597d45d-b1b6-4563-ade4-92e2de7552a1', 'volume_size': 1}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-698057816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0597d45d-b1b6-4563-ade4-92e2de7552a1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8c48f2c16f804de5ae667a2e7b086312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:34Z,use_quota=True,user_id='3e5b0edf834345f5bb7c41311ba991a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Creating volume 0597d45d-b1b6-4563-ade4-92e2de7552a1 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:35:34 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:35:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:34 devstack sudo[91633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1 1073741824
Nov 05 18:35:34 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:35 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1 1073741824" returned: 0 in 0.712s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:35 devstack sudo[91640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1
Nov 05 18:35:35 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:35 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1" returned: 0 in 0.373s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:35:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83eed4a5-f0c3-4d58-a974-8c704afbfd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0597d45d-b1b6-4563-ade4-92e2de7552a1', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1838ab69-a47c-4061-8cdc-b3f0fca4696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:35 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Volume volume-0597d45d-b1b6-4563-ade4-92e2de7552a1 (0597d45d-b1b6-4563-ade4-92e2de7552a1): created successfully
Nov 05 18:35:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1838ab69-a47c-4061-8cdc-b3f0fca4696b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Flow 'volume_create_manager' (bb2f04e8-f3c3-494d-b6e0-14ea33b82041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:35 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b721a8f4-c1ae-499a-ac7b-7721e3080cf3 tempest-VolumesListTestJSON-1470049589 None] Created volume successfully.
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Flow 'volume_create_manager' (e8738440-a88b-427a-966c-77434a738fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b491e1b3-3404-4f04-81a2-f824d6f384ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b491e1b3-3404-4f04-81a2-f824d6f384ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1991596639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2441a4b1-f72b-447a-9907-64634390c422,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8c48f2c16f804de5ae667a2e7b086312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:37Z,use_quota=True,user_id='3e5b0edf834345f5bb7c41311ba991a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2affb4a1-a202-4050-ac31-3dda99e2dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2affb4a1-a202-4050-ac31-3dda99e2dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc36e14-e9fc-4fdd-9a9c-ee74a91d851a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc36e14-e9fc-4fdd-9a9c-ee74a91d851a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2441a4b1-f72b-447a-9907-64634390c422', 'volume_name': 'volume-2441a4b1-f72b-447a-9907-64634390c422', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84429490-a05d-4127-8396-6c968c5dc26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84429490-a05d-4127-8396-6c968c5dc26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554e8b68-7330-4266-82bc-a6a945a187ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:37 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Volume 2441a4b1-f72b-447a-9907-64634390c422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2441a4b1-f72b-447a-9907-64634390c422', 'volume_size': 1}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1991596639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2441a4b1-f72b-447a-9907-64634390c422,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8c48f2c16f804de5ae667a2e7b086312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:37Z,use_quota=True,user_id='3e5b0edf834345f5bb7c41311ba991a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Creating volume 2441a4b1-f72b-447a-9907-64634390c422 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:35:37 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:35:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:37 devstack sudo[91681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422 1073741824
Nov 05 18:35:37 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:38 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422 1073741824" returned: 0 in 1.140s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:38 devstack sudo[91718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422
Nov 05 18:35:38 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:39 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422" returned: 0 in 0.679s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:35:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554e8b68-7330-4266-82bc-a6a945a187ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2441a4b1-f72b-447a-9907-64634390c422', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc50df8-6fe8-4008-97a8-858929c2db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:39 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Volume volume-2441a4b1-f72b-447a-9907-64634390c422 (2441a4b1-f72b-447a-9907-64634390c422): created successfully
Nov 05 18:35:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc50df8-6fe8-4008-97a8-858929c2db17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Flow 'volume_create_manager' (e8738440-a88b-427a-966c-77434a738fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-48bfe6ae-6d88-455e-ad80-b59254b1997f tempest-VolumesListTestJSON-1470049589 None] Created volume successfully.
Nov 05 18:35:44 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=83,cinder:UPDATE=68,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:35:44 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=72,cinder:UPDATE=86,cinder:DELETE=7,cinder:INSERT=21 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:35:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "cinder-2441a4b1-f72b-447a-9907-64634390c422-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-2441a4b1-f72b-447a-9907-64634390c422-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "cinder-quobyte-2441a4b1-f72b-447a-9907-64634390c422" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-quobyte-2441a4b1-f72b-447a-9907-64634390c422" acquired by "delete_volume" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:45 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[822a14cb-24f9-47e1-95ff-2bb7135994d1]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:45 devstack sudo[91771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422
Nov 05 18:35:45 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:46 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422" returned: 0 in 0.695s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:46 devstack sudo[91805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422
Nov 05 18:35:46 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:46 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2441a4b1-f72b-447a-9907-64634390c422" returned: 0 in 0.504s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-quobyte-2441a4b1-f72b-447a-9907-64634390c422" released by "delete_volume" :: held 1.281s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Created reservations ['fe1111f8-a9c7-413b-bb65-b8c3a0ae3543', '790010f2-1f17-4751-819f-9475f89531da', 'c8feb63f-5d69-4495-b3b7-82b7f7391288', 'ec063ea3-a455-43f6-8b0b-0a2c1ffa803e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:47 devstack sudo[91808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:35:47 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:47 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.478s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:47 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:35:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Deleted volume successfully.
Nov 05 18:35:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0c50f3d9-1c6b-4c34-8cdf-67a3cd8c9a5e tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-2441a4b1-f72b-447a-9907-64634390c422-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "cinder-0597d45d-b1b6-4563-ade4-92e2de7552a1-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-0597d45d-b1b6-4563-ade4-92e2de7552a1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "cinder-quobyte-0597d45d-b1b6-4563-ade4-92e2de7552a1" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-quobyte-0597d45d-b1b6-4563-ade4-92e2de7552a1" acquired by "delete_volume" :: waited 0.072s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:48 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90e7426-ccd2-45fd-93a0-aceb838471a3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:48 devstack sudo[91813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1
Nov 05 18:35:48 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:48 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1" returned: 0 in 0.754s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:49 devstack sudo[91820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1
Nov 05 18:35:49 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:49 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0597d45d-b1b6-4563-ade4-92e2de7552a1" returned: 0 in 0.393s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-quobyte-0597d45d-b1b6-4563-ade4-92e2de7552a1" released by "delete_volume" :: held 1.273s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:49 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Created reservations ['52c6a0c7-97cc-4d64-8f85-aa06740992c0', '80c345a6-c743-4773-8c0b-6c4ced1bbb0d', 'de776e12-2d8a-4ce0-aab0-3eca1f63eb2e', 'cc6e7a06-2e4e-4425-a2b3-0ce4a3087664'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:35:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:49 devstack sudo[91823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:35:49 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Flow 'volume_create_manager' (99c0a436-57b2-41b5-b600-bd6d24266ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9213beee-0f3a-4a12-b24e-4333e653633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9213beee-0f3a-4a12-b24e-4333e653633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1986512720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3543a2-84f5-4261-ae38-d82bf7a4d142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b729f251154c1787af0195543a1310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:50Z,use_quota=True,user_id='7b16fdfbbfda4ce98abe2761d9c2f6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0feabef-b7fe-4c94-9792-68156b9826d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0feabef-b7fe-4c94-9792-68156b9826d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a215c595-5136-4b06-951e-3639494d19ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:50 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a215c595-5136-4b06-951e-3639494d19ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d3543a2-84f5-4261-ae38-d82bf7a4d142', 'volume_name': 'volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b846a9b3-13c1-470d-9ea2-9d707f12b1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b846a9b3-13c1-470d-9ea2-9d707f12b1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a88cafd-c0c5-4f1d-bf5c-0794be39f0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:50 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Volume 3d3543a2-84f5-4261-ae38-d82bf7a4d142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142', 'volume_size': 1}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1986512720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3543a2-84f5-4261-ae38-d82bf7a4d142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b729f251154c1787af0195543a1310',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:35:50Z,use_quota=True,user_id='7b16fdfbbfda4ce98abe2761d9c2f6f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Creating volume 3d3543a2-84f5-4261-ae38-d82bf7a4d142 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:35:50 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.534s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:35:50 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Deleted volume successfully.
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d97df0-ff51-46ac-ac58-83a2fc23b80d tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-0597d45d-b1b6-4563-ade4-92e2de7552a1-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:50 devstack sudo[91827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142 1073741824
Nov 05 18:35:50 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "cinder-4e07af39-318f-487f-886c-9da0ca87a646-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-4e07af39-318f-487f-886c-9da0ca87a646-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "cinder-quobyte-4e07af39-318f-487f-886c-9da0ca87a646" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-quobyte-4e07af39-318f-487f-886c-9da0ca87a646" acquired by "delete_volume" :: waited 0.038s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5ef683-5773-421c-8665-f5b687a10cc5]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:35:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:51 devstack sudo[91833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646
Nov 05 18:35:51 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:51 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142 1073741824" returned: 0 in 1.098s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:51 devstack sudo[91837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142
Nov 05 18:35:51 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:51 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646" returned: 0 in 0.716s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:51 devstack sudo[91842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646
Nov 05 18:35:51 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:51 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142" returned: 0 in 0.425s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a88cafd-c0c5-4f1d-bf5c-0794be39f0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6270d201-9799-4cbd-811d-d7cfde384e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:35:51 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Volume volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142 (3d3543a2-84f5-4261-ae38-d82bf7a4d142): created successfully
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6270d201-9799-4cbd-811d-d7cfde384e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Flow 'volume_create_manager' (99c0a436-57b2-41b5-b600-bd6d24266ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:35:51 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5797755b-fb18-4891-b889-e4104831fbff tempest-TaggedAttachmentsTest-1009058891 None] Created volume successfully.
Nov 05 18:35:51 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4e07af39-318f-487f-886c-9da0ca87a646" returned: 0 in 0.436s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-quobyte-4e07af39-318f-487f-886c-9da0ca87a646" released by "delete_volume" :: held 1.275s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Created reservations ['74a7a61d-1b47-4d1e-8252-11b95febb8f7', 'd18d09ff-7c3f-4394-bd82-ad8b8477267d', '5be383c5-f949-4b8d-98ac-00fc23eb1af9', '876fa82f-99ef-4562-ba79-079ae5fcb5e5'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:35:52 devstack sudo[91846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:35:52 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:35:52 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.535s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:35:52 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Deleted volume successfully.
Nov 05 18:35:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1fea4ab3-6dcf-4ec4-8ac6-a22ee86b7296 tempest-VolumesListTestJSON-1470049589 None] Lock "cinder-4e07af39-318f-487f-886c-9da0ca87a646-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:35:53 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-2723bca6-5e60-4e15-bd48-18fc005b48ab req-ca21de57-17e6-4dd3-8b85-5e5de7666f18 tempest-ServerActionsTestOtherA-931331433 None] Terminate volume connection completed successfully.
Nov 05 18:35:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-2723bca6-5e60-4e15-bd48-18fc005b48ab req-ca21de57-17e6-4dd3-8b85-5e5de7666f18 tempest-ServerActionsTestOtherA-931331433 None] Deleting attachment 2da902bf-3ebb-4628-b690-e9d41d3050dd. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:35:54 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-16798903-0da2-4fab-b262-9d1b3e4485b7 req-ed16abea-c0b8-4285-951e-51611ef88a12 tempest-AttachVolumeTestJSON-1909145057 None] Terminate volume connection completed successfully.
Nov 05 18:35:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-16798903-0da2-4fab-b262-9d1b3e4485b7 req-ed16abea-c0b8-4285-951e-51611ef88a12 tempest-AttachVolumeTestJSON-1909145057 None] Deleting attachment b5a1fa01-4730-41df-8250-cafa4cf4d8db. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:35:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-2723bca6-5e60-4e15-bd48-18fc005b48ab req-49f3ea9c-3e67-48da-a8f2-1a486781b7a1 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:35:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-2723bca6-5e60-4e15-bd48-18fc005b48ab req-49f3ea9c-3e67-48da-a8f2-1a486781b7a1 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:35:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-2723bca6-5e60-4e15-bd48-18fc005b48ab req-49f3ea9c-3e67-48da-a8f2-1a486781b7a1 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:35:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-2723bca6-5e60-4e15-bd48-18fc005b48ab req-49f3ea9c-3e67-48da-a8f2-1a486781b7a1 tempest-ServerActionsTestOtherA-931331433 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-051b836b-21ef-4379-bb51-72f5a2f7744b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f1de94d-6c68-4ed5-bf76-4352cba60197', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:35:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-2723bca6-5e60-4e15-bd48-18fc005b48ab req-49f3ea9c-3e67-48da-a8f2-1a486781b7a1 tempest-ServerActionsTestOtherA-931331433 None] attachment_update completed successfully.
Nov 05 18:36:06 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=23,cinder:UPDATE=35,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:36:06 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=28,cinder:INSERT=7,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Flow 'volume_create_manager' (eba94776-1374-45a7-aa17-03834c5100dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa98f4b4-183a-4aae-92a7-b33a1007d802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa98f4b4-183a-4aae-92a7-b33a1007d802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1337237968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21146689-a3a3-4b53-b330-04ea17d8d40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053c6382ee44135b016033ada1f6313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:36:21Z,use_quota=True,user_id='2581cba6c55942fb8f2e071d961e5a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bdb2fb-7b71-429e-af7d-5a2fe7ba2205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bdb2fb-7b71-429e-af7d-5a2fe7ba2205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8460c9e7-60a5-4ead-b865-b8c566bc7187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8460c9e7-60a5-4ead-b865-b8c566bc7187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21146689-a3a3-4b53-b330-04ea17d8d40a', 'volume_name': 'volume-21146689-a3a3-4b53-b330-04ea17d8d40a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ca319d-d662-4045-b7ea-327860f81d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ca319d-d662-4045-b7ea-327860f81d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9106cb5-6e85-4f36-a706-0dd0bea52c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:21 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Volume 21146689-a3a3-4b53-b330-04ea17d8d40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21146689-a3a3-4b53-b330-04ea17d8d40a', 'volume_size': 1}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1337237968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21146689-a3a3-4b53-b330-04ea17d8d40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053c6382ee44135b016033ada1f6313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:36:21Z,use_quota=True,user_id='2581cba6c55942fb8f2e071d961e5a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Creating volume 21146689-a3a3-4b53-b330-04ea17d8d40a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:36:21 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:36:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:21 devstack sudo[92593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a 1073741824
Nov 05 18:36:21 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:22 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a 1073741824" returned: 0 in 0.507s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:22 devstack sudo[92603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a
Nov 05 18:36:22 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:22 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a" returned: 0 in 0.246s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:36:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9106cb5-6e85-4f36-a706-0dd0bea52c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21146689-a3a3-4b53-b330-04ea17d8d40a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c975f58-2482-454b-9529-52d1f3f93fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:22 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Volume volume-21146689-a3a3-4b53-b330-04ea17d8d40a (21146689-a3a3-4b53-b330-04ea17d8d40a): created successfully
Nov 05 18:36:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c975f58-2482-454b-9529-52d1f3f93fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Flow 'volume_create_manager' (eba94776-1374-45a7-aa17-03834c5100dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:36:22 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fb6342c3-1f3c-480f-858f-23c3aeb4676d tempest-VolumesSnapshotTestJSON-1187972809 None] Created volume successfully.
Nov 05 18:36:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Creating offline snapshot 1bedb585-8f20-49a6-999d-52ba6051d05b of volume 21146689-a3a3-4b53-b330-04ea17d8d40a {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:36:23 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaf17b7-267c-4cb2-9697-8ca537debbcc]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:23 devstack sudo[92606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a
Nov 05 18:36:23 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:24 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a" returned: 0 in 0.392s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:24 devstack sudo[92611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b 1G
Nov 05 18:36:24 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:24 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b 1G" returned: 0 in 0.431s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21146689-a3a3-4b53-b330-04ea17d8d40a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:24 devstack sudo[92617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21146689-a3a3-4b53-b330-04ea17d8d40a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b
Nov 05 18:36:24 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:24 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21146689-a3a3-4b53-b330-04ea17d8d40a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b" returned: 0 in 0.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:24 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b is being set with open permissions: ugo+rw
Nov 05 18:36:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:24 devstack sudo[92622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b
Nov 05 18:36:24 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:25 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b" returned: 0 in 0.246s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:25 devstack sudo[92625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.info
Nov 05 18:36:25 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:25 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.info" returned: 0 in 0.244s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:25 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.info is being set with open permissions: ugo+rw
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:25 devstack sudo[92628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.info
Nov 05 18:36:25 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:25 devstack sudo[92630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:36:25 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:25 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.info" returned: 0 in 0.251s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:25 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8bc71f6e-534e-42fa-ab15-14d6cdc714c4 tempest-VolumesSnapshotTestJSON-1187972809 None] Create snapshot completed successfully
Nov 05 18:36:25 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.291s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-1bedb585-8f20-49a6-999d-52ba6051d05b-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-1bedb585-8f20-49a6-999d-52ba6051d05b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-21146689-a3a3-4b53-b330-04ea17d8d40a" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-21146689-a3a3-4b53-b330-04ea17d8d40a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-1bedb585-8f20-49a6-999d-52ba6051d05b" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-1bedb585-8f20-49a6-999d-52ba6051d05b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Deleting offline snapshot 1bedb585-8f20-49a6-999d-52ba6051d05b of volume 21146689-a3a3-4b53-b330-04ea17d8d40a {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] snapshot_file for this snap is: volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f38851e-3eed-4d47-97f9-f19853f7e500]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:26 devstack sudo[92634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b
Nov 05 18:36:26 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:26 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b" returned: 0 in 0.392s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21146689-a3a3-4b53-b330-04ea17d8d40a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e456b23e-8d9f-4edc-82eb-42e7f61f4a35]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:26 devstack sudo[92640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a
Nov 05 18:36:26 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:27 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a" returned: 0 in 0.440s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:27 devstack sudo[92646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b
Nov 05 18:36:27 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:27 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b" returned: 0 in 0.432s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:27 devstack sudo[92666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b
Nov 05 18:36:27 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:27 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a.1bedb585-8f20-49a6-999d-52ba6051d05b" returned: 0 in 0.292s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-1bedb585-8f20-49a6-999d-52ba6051d05b" released by "_delete_snapshot" :: held 1.712s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-21146689-a3a3-4b53-b330-04ea17d8d40a" released by "delete_snapshot" :: held 1.742s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:27 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Created reservations ['322c2c3c-c6a7-4082-aa94-5b4ffe07bb8f', '6cfa80a1-1fe8-423e-a07f-73ea2ea1e4d1', 'a6d7ac2c-821b-4e0e-a4a6-09b9242eae91', '1d79d1e4-df10-48bd-8958-3cf8925e6a00'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:36:28 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Delete snapshot completed successfully.
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-992fb9a5-cb96-4a7f-9768-8580609aeb58 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-1bedb585-8f20-49a6-999d-52ba6051d05b-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Flow 'volume_create_manager' (52257f17-facb-4064-bf4c-dc4e23c09a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b292723b-b10b-48a1-a1ee-cbe9c3fc4138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b292723b-b10b-48a1-a1ee-cbe9c3fc4138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1867103026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0fb567-f35a-49df-a7c1-cd293850e2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053c6382ee44135b016033ada1f6313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:36:29Z,use_quota=True,user_id='2581cba6c55942fb8f2e071d961e5a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce42bc8-9fb5-4f40-9d7c-a90c076f12ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce42bc8-9fb5-4f40-9d7c-a90c076f12ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac50dad-cfba-4f00-950c-3fdf1cde36ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac50dad-cfba-4f00-950c-3fdf1cde36ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0fb567-f35a-49df-a7c1-cd293850e2e3', 'volume_name': 'volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8693d43-7dde-4709-9057-6af055192703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8693d43-7dde-4709-9057-6af055192703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e516a4-4276-401c-b6dc-fb5d7d8dfc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:28 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Volume 4b0fb567-f35a-49df-a7c1-cd293850e2e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3', 'volume_size': 1}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1867103026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b0fb567-f35a-49df-a7c1-cd293850e2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053c6382ee44135b016033ada1f6313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:36:29Z,use_quota=True,user_id='2581cba6c55942fb8f2e071d961e5a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Creating volume 4b0fb567-f35a-49df-a7c1-cd293850e2e3 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:36:28 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:36:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:28 devstack sudo[92669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 1073741824
Nov 05 18:36:28 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:29 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 1073741824" returned: 0 in 0.458s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:29 devstack sudo[92675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3
Nov 05 18:36:29 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:29 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3" returned: 0 in 0.266s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:36:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e516a4-4276-401c-b6dc-fb5d7d8dfc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf38df6c-f255-44c4-b8de-0ec88a5bfde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:29 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Volume volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 (4b0fb567-f35a-49df-a7c1-cd293850e2e3): created successfully
Nov 05 18:36:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf38df6c-f255-44c4-b8de-0ec88a5bfde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Flow 'volume_create_manager' (52257f17-facb-4064-bf4c-dc4e23c09a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:36:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-34febf41-0436-4cca-9da0-aae5e33e8ff5 tempest-VolumesSnapshotTestJSON-1187972809 None] Created volume successfully.
Nov 05 18:36:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Creating offline snapshot 89476f85-7e47-4bd5-b0c0-a5e3c671aff4 of volume 4b0fb567-f35a-49df-a7c1-cd293850e2e3 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:36:31 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[863abd5f-af0f-49fb-8e49-608d8bfe13da]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:31 devstack sudo[92687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3
Nov 05 18:36:31 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:31 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3" returned: 0 in 0.363s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:31 devstack sudo[92692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 1G
Nov 05 18:36:31 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:31 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 1G" returned: 0 in 0.398s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:31 devstack sudo[92697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4
Nov 05 18:36:31 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:32 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4" returned: 0 in 0.289s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:32 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 is being set with open permissions: ugo+rw
Nov 05 18:36:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:32 devstack sudo[92702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4
Nov 05 18:36:32 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:32 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4" returned: 0 in 0.248s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:32 devstack sudo[92705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.info
Nov 05 18:36:32 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:32 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.info" returned: 0 in 0.270s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:32 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.info is being set with open permissions: ugo+rw
Nov 05 18:36:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:32 devstack sudo[92710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.info
Nov 05 18:36:32 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:32 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.info" returned: 0 in 0.275s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b418a3d7-c329-4076-8ff7-4fb7854d3456 tempest-VolumesSnapshotTestJSON-1187972809 None] Create snapshot completed successfully
Nov 05 18:36:33 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:36:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Flow 'volume_create_manager' (0d1dfa59-7303-483b-bcb4-360c2a45f4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:36:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63423e4d-cadf-43f2-87a9-e9841a3cf2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63423e4d-cadf-43f2-87a9-e9841a3cf2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1815152384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d63d06e-5e21-4eb5-afef-a075b5d791e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053c6382ee44135b016033ada1f6313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:36:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=89476f85-7e47-4bd5-b0c0-a5e3c671aff4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:36:34Z,use_quota=True,user_id='2581cba6c55942fb8f2e071d961e5a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b092695-43e7-41f9-b75d-0ca802e0ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b092695-43e7-41f9-b75d-0ca802e0ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4522bbf8-ac44-40bd-b72b-7817be2c70b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4522bbf8-ac44-40bd-b72b-7817be2c70b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d63d06e-5e21-4eb5-afef-a075b5d791e8', 'volume_name': 'volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8', 'volume_size': 2, 'snapshot_id': '89476f85-7e47-4bd5-b0c0-a5e3c671aff4'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a6fb03-4eb2-481d-9eb5-bae874d485f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a6fb03-4eb2-481d-9eb5-bae874d485f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d823030a-6029-41fa-8192-b51dd02c7f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:34 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Volume 8d63d06e-5e21-4eb5-afef-a075b5d791e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8', 'volume_size': 2, 'snapshot_id': '89476f85-7e47-4bd5-b0c0-a5e3c671aff4'}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-89476f85-7e47-4bd5-b0c0-a5e3c671aff4-8d63d06e-5e21-4eb5-afef-a075b5d791e8" by "_create_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-89476f85-7e47-4bd5-b0c0-a5e3c671aff4-8d63d06e-5e21-4eb5-afef-a075b5d791e8" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Creating volume 8d63d06e-5e21-4eb5-afef-a075b5d791e8 from snapshot 89476f85-7e47-4bd5-b0c0-a5e3c671aff4 {{(pid=87086) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-8d63d06e-5e21-4eb5-afef-a075b5d791e8" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-8d63d06e-5e21-4eb5-afef-a075b5d791e8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] snapshot: 89476f85-7e47-4bd5-b0c0-a5e3c671aff4, volume: 8d63d06e-5e21-4eb5-afef-a075b5d791e8,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2df00f-fb87-4bdd-8219-ced67b1a5793]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:34 devstack sudo[92740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4
Nov 05 18:36:34 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:34 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4" returned: 0 in 0.477s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d095a1-a886-4250-8c9d-039669593e44]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:34 devstack sudo[92747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3
Nov 05 18:36:34 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:35 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3" returned: 0 in 0.444s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8 not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:35 devstack sudo[92753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8
Nov 05 18:36:35 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:35 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-af6adf9a-e3b0-4387-8959-e44f054307ae tempest-ServerActionsTestOtherA-931331433 None] Terminate volume connection completed successfully.
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-af6adf9a-e3b0-4387-8959-e44f054307ae tempest-ServerActionsTestOtherA-931331433 None] Deleting attachment 4f1de94d-6c68-4ed5-bf76-4352cba60197. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "cinder-051b836b-21ef-4379-bb51-72f5a2f7744b-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Lock "cinder-051b836b-21ef-4379-bb51-72f5a2f7744b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "cinder-quobyte-051b836b-21ef-4379-bb51-72f5a2f7744b" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Lock "cinder-quobyte-051b836b-21ef-4379-bb51-72f5a2f7744b" acquired by "delete_volume" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbbf04d-a5c2-4d73-b9b7-6fe23e7ab016]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:35 devstack sudo[92759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b
Nov 05 18:36:35 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:36 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b" returned: 0 in 0.729s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:36 devstack sudo[92771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b
Nov 05 18:36:36 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:36 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-051b836b-21ef-4379-bb51-72f5a2f7744b" returned: 0 in 0.356s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Lock "cinder-quobyte-051b836b-21ef-4379-bb51-72f5a2f7744b" released by "delete_volume" :: held 1.155s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:36 devstack cinder-volume[87086]: DEBUG cinder.quota [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Created reservations ['7c4e933d-7ae0-4fd8-b550-11e19a75f0e4', 'c5550941-2ed7-4c11-9059-c79e4f9b5af3', '7d340993-7304-4a32-acf9-02521609dd2d', '00f3990b-2b23-44e9-ae7d-0d087603e28d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:37 devstack sudo[92778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:36:37 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "cinder-049c059d-861c-4cfa-bdd2-bbb5ff677cc1-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Lock "cinder-049c059d-861c-4cfa-bdd2-bbb5ff677cc1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:37 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG cinder.manager [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:36:37 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Deleted volume successfully.
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "cinder-quobyte-049c059d-861c-4cfa-bdd2-bbb5ff677cc1" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-7aed8d76-6f7e-4f5e-a374-1699dc4f5a39 req-53e09f3d-8bae-486e-b943-3d3a21f692fe tempest-ServerActionsTestOtherA-931331433 None] Lock "cinder-051b836b-21ef-4379-bb51-72f5a2f7744b-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Lock "cinder-quobyte-049c059d-861c-4cfa-bdd2-bbb5ff677cc1" acquired by "delete_volume" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[469a898d-05c9-4699-ac7f-6fc254d17fc7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:37 devstack sudo[92784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1
Nov 05 18:36:37 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:38 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1" returned: 0 in 0.723s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:38 devstack sudo[92790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1
Nov 05 18:36:38 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:38 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-049c059d-861c-4cfa-bdd2-bbb5ff677cc1" returned: 0 in 0.507s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Lock "cinder-quobyte-049c059d-861c-4cfa-bdd2-bbb5ff677cc1" released by "delete_volume" :: held 1.370s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Created reservations ['5d90bb7d-4d47-448f-a646-abca2e604e89', '91c645b7-8d82-4100-8e1a-132e0c7a5609', 'd2ff8114-a89a-45c6-948c-26cc2a0e6c71', '701d30ae-daba-44ca-a234-81db854d55e1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:39 devstack sudo[92827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:36:39 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:39 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.354s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:36:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Deleted volume successfully.
Nov 05 18:36:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-15d1abc1-8f4f-457d-8fb6-926707543d10 tempest-ServerActionsTestOtherA-931331433 None] Lock "cinder-049c059d-861c-4cfa-bdd2-bbb5ff677cc1-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:44 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8" returned: 0 in 9.831s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:44 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3, size 1024.00 MB, duration 9.83 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:36:44 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Converted 1024.00 MB image at 104.15 MB/s
Nov 05 18:36:44 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8 is being set with open permissions: ugo+rw
Nov 05 18:36:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:45 devstack sudo[92912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8
Nov 05 18:36:45 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:45 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8" returned: 0 in 0.366s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-8d63d06e-5e21-4eb5-afef-a075b5d791e8" released by "_copy_volume_from_snapshot" :: held 11.261s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-89476f85-7e47-4bd5-b0c0-a5e3c671aff4-8d63d06e-5e21-4eb5-afef-a075b5d791e8" released by "_create_volume_from_snapshot" :: held 11.347s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.370s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d823030a-6029-41fa-8192-b51dd02c7f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8', 'volume_size': 2, 'snapshot_id': '89476f85-7e47-4bd5-b0c0-a5e3c671aff4'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38c3a47-c48d-483b-ad43-0294ff4cb4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:45 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Volume volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8 (8d63d06e-5e21-4eb5-afef-a075b5d791e8): created successfully
Nov 05 18:36:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38c3a47-c48d-483b-ad43-0294ff4cb4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Flow 'volume_create_manager' (0d1dfa59-7303-483b-bcb4-360c2a45f4dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:36:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d718e190-365a-418a-ad90-859804eb590b tempest-VolumesSnapshotTestJSON-1187972809 None] Created volume successfully.
Nov 05 18:36:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-8d63d06e-5e21-4eb5-afef-a075b5d791e8-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-8d63d06e-5e21-4eb5-afef-a075b5d791e8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-8d63d06e-5e21-4eb5-afef-a075b5d791e8" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-8d63d06e-5e21-4eb5-afef-a075b5d791e8" acquired by "delete_volume" :: waited 0.062s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:47 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc5d2d6-d91e-471f-8050-2d92dd7c4d2a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:47 devstack sudo[92953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8
Nov 05 18:36:47 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:47 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8" returned: 0 in 0.515s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:47 devstack sudo[92970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8
Nov 05 18:36:47 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:48 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8d63d06e-5e21-4eb5-afef-a075b5d791e8" returned: 0 in 0.409s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-8d63d06e-5e21-4eb5-afef-a075b5d791e8" released by "delete_volume" :: held 1.020s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Created reservations ['53f71a58-aaa4-4276-9835-4cd3bd09e129', '9f2ca707-2225-45d8-bf7d-db8c9b9cbb51', 'd34784b6-4663-4f82-bf46-3374d74a5074', '83a39d9c-0c43-40ac-82a0-6a0992b165d8'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:48 devstack sudo[92979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:36:48 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-f5efab90-62a0-41ee-97bb-6a59fccea681 req-6aeea3a9-3209-4161-ba56-b6f9e7446879 tempest-TaggedAttachmentsTest-1009058891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-f5efab90-62a0-41ee-97bb-6a59fccea681 req-6aeea3a9-3209-4161-ba56-b6f9e7446879 tempest-TaggedAttachmentsTest-1009058891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:48 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-f5efab90-62a0-41ee-97bb-6a59fccea681 req-6aeea3a9-3209-4161-ba56-b6f9e7446879 tempest-TaggedAttachmentsTest-1009058891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.360s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:36:48 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Deleted volume successfully.
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-f5efab90-62a0-41ee-97bb-6a59fccea681 req-6aeea3a9-3209-4161-ba56-b6f9e7446879 tempest-TaggedAttachmentsTest-1009058891 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3438175-45c2-43a9-aa34-7d1e4ef005b6', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:36:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-897d6bd7-1863-44c6-907f-0cea372e5d1f tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-8d63d06e-5e21-4eb5-afef-a075b5d791e8-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:48 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-f5efab90-62a0-41ee-97bb-6a59fccea681 req-6aeea3a9-3209-4161-ba56-b6f9e7446879 tempest-TaggedAttachmentsTest-1009058891 None] attachment_update completed successfully.
Nov 05 18:36:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-89476f85-7e47-4bd5-b0c0-a5e3c671aff4-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-89476f85-7e47-4bd5-b0c0-a5e3c671aff4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-4b0fb567-f35a-49df-a7c1-cd293850e2e3" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-4b0fb567-f35a-49df-a7c1-cd293850e2e3" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-89476f85-7e47-4bd5-b0c0-a5e3c671aff4" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-89476f85-7e47-4bd5-b0c0-a5e3c671aff4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Deleting offline snapshot 89476f85-7e47-4bd5-b0c0-a5e3c671aff4 of volume 4b0fb567-f35a-49df-a7c1-cd293850e2e3 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:36:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] snapshot_file for this snap is: volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:36:49 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a435323-cb02-4ac2-a313-ae14272e21c2]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:49 devstack sudo[93404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4
Nov 05 18:36:49 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:50 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4" returned: 0 in 0.566s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:36:50 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b0c1c1-8e61-4731-8908-b461d5bbbae6]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:50 devstack sudo[93410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3
Nov 05 18:36:50 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:50 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3" returned: 0 in 0.604s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:50 devstack sudo[93417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4
Nov 05 18:36:50 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:51 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4" returned: 0 in 0.449s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:51 devstack sudo[93425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4
Nov 05 18:36:51 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:51 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3.89476f85-7e47-4bd5-b0c0-a5e3c671aff4" returned: 0 in 0.275s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-89476f85-7e47-4bd5-b0c0-a5e3c671aff4" released by "_delete_snapshot" :: held 2.043s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-4b0fb567-f35a-49df-a7c1-cd293850e2e3" released by "delete_snapshot" :: held 2.072s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:51 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Created reservations ['6ccfe58d-60ca-47ed-b49c-978d7f1fe555', 'e261adcb-e83c-49a6-90be-db2ebdba381a', '166716ba-487a-4b3c-b1e9-2a47ec76a4a2', 'd9c986f5-8210-484a-bf3c-005dcf3bdd73'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:36:51 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Delete snapshot completed successfully.
Nov 05 18:36:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a876b226-11fc-41da-aea7-73fc8c93a8c3 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-89476f85-7e47-4bd5-b0c0-a5e3c671aff4-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-4b0fb567-f35a-49df-a7c1-cd293850e2e3-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-4b0fb567-f35a-49df-a7c1-cd293850e2e3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-4b0fb567-f35a-49df-a7c1-cd293850e2e3" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:36:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-4b0fb567-f35a-49df-a7c1-cd293850e2e3" acquired by "delete_volume" :: waited 0.034s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:36:53 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde416e8-b9c6-49ca-b067-8ea03449b14a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:53 devstack sudo[93429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3
Nov 05 18:36:53 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:53 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-b31f15d5-d143-426c-98b1-97edbfbcd9fc req-f33c4dc8-827f-422f-a540-eab27e93ddf0 tempest-TaggedAttachmentsTest-1009058891 None] Terminate volume connection completed successfully.
Nov 05 18:36:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-b31f15d5-d143-426c-98b1-97edbfbcd9fc req-f33c4dc8-827f-422f-a540-eab27e93ddf0 tempest-TaggedAttachmentsTest-1009058891 None] Deleting attachment c3438175-45c2-43a9-aa34-7d1e4ef005b6. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:36:53 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3" returned: 0 in 0.527s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:53 devstack sudo[93462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3
Nov 05 18:36:53 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:53 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4b0fb567-f35a-49df-a7c1-cd293850e2e3" returned: 0 in 0.356s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-4b0fb567-f35a-49df-a7c1-cd293850e2e3" released by "delete_volume" :: held 1.006s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:54 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Created reservations ['07b8eb4e-b09b-4746-9fa8-dd898f74a23a', 'c90668bc-9c2c-4c96-b755-7b083b28d32c', '10e4fcbe-c730-4f49-b916-cb9fb6e31c81', '3cccb117-9c26-4450-a831-38227a3cf65c'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:36:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:36:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:36:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:54 devstack sudo[93470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:36:54 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:54 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.451s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:54 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:36:54 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Deleted volume successfully.
Nov 05 18:36:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d8cc7e-f4b1-4082-905b-a49983eac7d0 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-4b0fb567-f35a-49df-a7c1-cd293850e2e3-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Flow 'volume_create_manager' (32199b64-fe95-4836-88a3-17e455a6512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a35f46-d9d1-4523-be90-b89bc4f64291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a35f46-d9d1-4523-be90-b89bc4f64291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-785888101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a0fea1-f4d0-4d21-9013-77ed19d7fa9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053c6382ee44135b016033ada1f6313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:36:56Z,use_quota=True,user_id='2581cba6c55942fb8f2e071d961e5a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9386fa96-9eb1-4494-a4cc-27a0eedf8275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9386fa96-9eb1-4494-a4cc-27a0eedf8275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd64d189-9900-4a37-9ad0-54c993397e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd64d189-9900-4a37-9ad0-54c993397e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a0fea1-f4d0-4d21-9013-77ed19d7fa9e', 'volume_name': 'volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac12dbab-d59a-4986-8ee0-1b959b0c3db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac12dbab-d59a-4986-8ee0-1b959b0c3db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0020002-a79e-48ff-b283-0f91996e665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:56 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Volume 04a0fea1-f4d0-4d21-9013-77ed19d7fa9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e', 'volume_size': 1}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-785888101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a0fea1-f4d0-4d21-9013-77ed19d7fa9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053c6382ee44135b016033ada1f6313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:36:56Z,use_quota=True,user_id='2581cba6c55942fb8f2e071d961e5a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Creating volume 04a0fea1-f4d0-4d21-9013-77ed19d7fa9e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:36:56 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:56 devstack sudo[93496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e 1073741824
Nov 05 18:36:56 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:56 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e 1073741824" returned: 0 in 0.577s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:56 devstack sudo[93505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e
Nov 05 18:36:56 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:57 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" returned: 0 in 0.622s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:36:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:36:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0020002-a79e-48ff-b283-0f91996e665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a72440-1c14-4880-8439-511f61119a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:36:57 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Volume volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e (04a0fea1-f4d0-4d21-9013-77ed19d7fa9e): created successfully
Nov 05 18:36:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a72440-1c14-4880-8439-511f61119a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:36:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Flow 'volume_create_manager' (32199b64-fe95-4836-88a3-17e455a6512b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:36:57 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c2f1c2bb-8871-4a78-aed8-87fa50f65c02 tempest-VolumesSnapshotTestJSON-1187972809 None] Created volume successfully.
Nov 05 18:36:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:36:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:36:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Creating offline snapshot c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 of volume 04a0fea1-f4d0-4d21-9013-77ed19d7fa9e {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:36:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e1b417-b7b7-4d0e-904b-554c2b769d4b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:36:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:58 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e
Nov 05 18:36:58 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:59 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" returned: 0 in 0.541s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:59 devstack sudo[93526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 1G
Nov 05 18:36:59 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:36:59 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root
Nov 05 18:36:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 1G" returned: 0 in 0.778s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:36:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:36:59 devstack sudo[93554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8
Nov 05 18:36:59 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:00 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8" returned: 0 in 0.361s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:00 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 is being set with open permissions: ugo+rw
Nov 05 18:37:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:00 devstack sudo[93561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8
Nov 05 18:37:00 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:00 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8" returned: 0 in 0.288s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:00 devstack sudo[93564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.info
Nov 05 18:37:00 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:00 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.info" returned: 0 in 0.291s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:00 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.info is being set with open permissions: ugo+rw
Nov 05 18:37:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:00 devstack sudo[93568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.info
Nov 05 18:37:00 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:01 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.info" returned: 0 in 0.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.679s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:01 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-06b37b9c-d241-4727-9bcd-dc542a2ca1d6 tempest-VolumesSnapshotTestJSON-1187972809 None] Create snapshot completed successfully
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Flow 'volume_create_manager' (cf42175b-7a1c-464e-9cb2-2b5d1f57654c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85256381-8b8f-488a-ace1-b1f8e6552390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85256381-8b8f-488a-ace1-b1f8e6552390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1014065770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56a7630-56ac-4f19-8052-c57e57a35813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053c6382ee44135b016033ada1f6313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:03Z,use_quota=True,user_id='2581cba6c55942fb8f2e071d961e5a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d4d7e9-42ba-44cf-97ca-bc7351b9dc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d4d7e9-42ba-44cf-97ca-bc7351b9dc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68cd905e-2264-4905-ac61-c54287ed024f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68cd905e-2264-4905-ac61-c54287ed024f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e56a7630-56ac-4f19-8052-c57e57a35813', 'volume_name': 'volume-e56a7630-56ac-4f19-8052-c57e57a35813', 'volume_size': 1, 'snapshot_id': 'c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc820a5d-d2a3-4052-8fe6-bd2ad61e4cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc820a5d-d2a3-4052-8fe6-bd2ad61e4cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b986c3d6-e0a5-4c0e-aa06-44e9c0cc196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Volume e56a7630-56ac-4f19-8052-c57e57a35813: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e56a7630-56ac-4f19-8052-c57e57a35813', 'volume_size': 1, 'snapshot_id': 'c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8'}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8-e56a7630-56ac-4f19-8052-c57e57a35813" by "_create_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8-e56a7630-56ac-4f19-8052-c57e57a35813" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Creating volume e56a7630-56ac-4f19-8052-c57e57a35813 from snapshot c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 {{(pid=87086) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-e56a7630-56ac-4f19-8052-c57e57a35813" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-e56a7630-56ac-4f19-8052-c57e57a35813" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] snapshot: c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8, volume: e56a7630-56ac-4f19-8052-c57e57a35813,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:03 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[0334e2c7-0efb-4b39-93ab-c58cfa670022]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:03 devstack sudo[93629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8
Nov 05 18:37:03 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:03 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8" returned: 0 in 0.532s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:37:03 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a6b888-d5c1-40a5-882e-e2422ffae914]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:03 devstack sudo[93642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e
Nov 05 18:37:03 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:04 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" returned: 0 in 0.565s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:37:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:37:04 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813 not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:37:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:04 devstack sudo[93648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813
Nov 05 18:37:04 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Acquiring lock "cinder-3d3543a2-84f5-4261-ae38-d82bf7a4d142-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Lock "cinder-3d3543a2-84f5-4261-ae38-d82bf7a4d142-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Acquiring lock "cinder-quobyte-3d3543a2-84f5-4261-ae38-d82bf7a4d142" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Lock "cinder-quobyte-3d3543a2-84f5-4261-ae38-d82bf7a4d142" acquired by "delete_volume" :: waited 0.061s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:11 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[02425c84-a036-49dd-8099-8cca167757cc]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:12 devstack sudo[93667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142
Nov 05 18:37:12 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:13 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142" returned: 0 in 1.342s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:13 devstack sudo[93672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142
Nov 05 18:37:13 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:14 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d3543a2-84f5-4261-ae38-d82bf7a4d142" returned: 0 in 1.045s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Lock "cinder-quobyte-3d3543a2-84f5-4261-ae38-d82bf7a4d142" released by "delete_volume" :: held 2.604s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:14 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Created reservations ['b2396b51-3867-4395-95e6-46b10e88b86d', '3928497b-d7d8-4b77-b8d2-1928383a10e1', 'd94a4bb1-29c3-4851-8fcc-bb212b66e578', '0f15ebe9-fbd5-4e4f-9ad5-9a04327a6b46'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:37:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:14 devstack sudo[93677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:37:14 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:15 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813" returned: 0 in 11.375s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:15 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e, size 1024.00 MB, duration 11.38 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:37:15 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Converted 1024.00 MB image at 89.96 MB/s
Nov 05 18:37:15 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813 is being set with open permissions: ugo+rw
Nov 05 18:37:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:15 devstack sudo[93680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813
Nov 05 18:37:15 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:15 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.871s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:15 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:37:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Deleted volume successfully.
Nov 05 18:37:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1dbf6b5d-914a-46ca-b254-ab729100518e tempest-TaggedAttachmentsTest-1009058891 None] Lock "cinder-3d3543a2-84f5-4261-ae38-d82bf7a4d142-delete_volume" released by "delete_volume" :: held 4.217s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:15 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813" returned: 0 in 0.429s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-e56a7630-56ac-4f19-8052-c57e57a35813" released by "_copy_volume_from_snapshot" :: held 13.099s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8-e56a7630-56ac-4f19-8052-c57e57a35813" released by "_create_volume_from_snapshot" :: held 13.237s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.262s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b986c3d6-e0a5-4c0e-aa06-44e9c0cc196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56a7630-56ac-4f19-8052-c57e57a35813', 'volume_size': 1, 'snapshot_id': 'c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b242a576-a016-47dc-8e1c-5365847c171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:16 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Volume volume-e56a7630-56ac-4f19-8052-c57e57a35813 (e56a7630-56ac-4f19-8052-c57e57a35813): created successfully
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b242a576-a016-47dc-8e1c-5365847c171c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Flow 'volume_create_manager' (cf42175b-7a1c-464e-9cb2-2b5d1f57654c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:16 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a3f1d652-1dee-4f13-b94d-1ec27bc105a4 tempest-VolumesSnapshotTestJSON-1187972809 None] Created volume successfully.
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-e56a7630-56ac-4f19-8052-c57e57a35813-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-e56a7630-56ac-4f19-8052-c57e57a35813-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=79,cinder:UPDATE=68,cinder:DELETE=8,cinder:INSERT=18 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=78,cinder:INSERT=18,cinder:SELECT=70,cinder:DELETE=5 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:37:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-e56a7630-56ac-4f19-8052-c57e57a35813" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:17 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-e56a7630-56ac-4f19-8052-c57e57a35813" acquired by "delete_volume" :: waited 0.065s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:17 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ead1ec-50d2-457c-877b-3b13e7e59fab]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:17 devstack sudo[93684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813
Nov 05 18:37:17 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:17 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813" returned: 0 in 0.677s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:17 devstack sudo[93724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813
Nov 05 18:37:17 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:18 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e56a7630-56ac-4f19-8052-c57e57a35813" returned: 0 in 0.321s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-e56a7630-56ac-4f19-8052-c57e57a35813" released by "delete_volume" :: held 1.094s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Created reservations ['44324540-86b4-4378-b755-be44f5e0a490', '287be9fb-28ef-418b-a86f-16612653e05b', '383c735d-8510-4ab4-953a-7ace7f911065', '5f68e5d0-a120-4024-b091-b04fb2d9298f'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:18 devstack sudo[93727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:37:18 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:18 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.261s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:37:18 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Deleted volume successfully.
Nov 05 18:37:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1ead9fb8-e3bf-4572-83d5-799b09a7f9fe tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-e56a7630-56ac-4f19-8052-c57e57a35813-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Deleting offline snapshot c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 of volume 04a0fea1-f4d0-4d21-9013-77ed19d7fa9e {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] snapshot_file for this snap is: volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[19495d6b-300f-4ed1-8cae-709d6b47f090]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:19 devstack sudo[93731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8
Nov 05 18:37:19 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:19 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8" returned: 0 in 0.520s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c75f4bb-c935-4da0-929f-491811374e8b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:20 devstack sudo[93739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e
Nov 05 18:37:20 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:20 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" returned: 0 in 0.729s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:20 devstack sudo[93745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8
Nov 05 18:37:20 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:21 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8" returned: 0 in 0.518s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:21 devstack sudo[93754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8
Nov 05 18:37:21 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:21 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e.c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8" returned: 0 in 0.347s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8" released by "_delete_snapshot" :: held 2.307s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" released by "delete_snapshot" :: held 2.357s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:21 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Created reservations ['c789ccd4-1a02-4386-b0a3-b94e28996b07', '21052206-9428-425a-a25d-f6e91d125fa7', 'd6fbed58-4005-4f72-8ba7-cda515b526aa', 'dab4db27-79f2-4e76-bf9b-cd27de945bd4'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:37:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Delete snapshot completed successfully.
Nov 05 18:37:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-388f1981-dd56-4ac5-9649-4334bcb58456 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-c1f6ab42-be3e-489d-a51a-2a5fab9fc3e8-delete_snapshot" released by "delete_snapshot" :: held 2.678s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa6dc7c-1c7a-42b8-9076-b156470f4e89]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:22 devstack sudo[93776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e
Nov 05 18:37:22 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:23 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" returned: 0 in 0.551s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:23 devstack sudo[93789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e
Nov 05 18:37:23 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:23 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" returned: 0 in 0.355s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e" released by "delete_volume" :: held 1.013s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Created reservations ['51a02613-78a9-45cb-83b8-e2dad89b9c93', 'cf54cac4-20b3-450c-873e-dc087eada3d1', '4b932606-aa89-4617-b1c2-3ca87c1bc568', '8841cf4c-153c-4b3a-a1b2-5882cee8d931'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:23 devstack sudo[93803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:37:23 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:24 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.294s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:24 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:37:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Deleted volume successfully.
Nov 05 18:37:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d33dfa5f-406f-4a6e-9500-d040f7dae462 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-04a0fea1-f4d0-4d21-9013-77ed19d7fa9e-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-21146689-a3a3-4b53-b330-04ea17d8d40a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-21146689-a3a3-4b53-b330-04ea17d8d40a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "cinder-quobyte-21146689-a3a3-4b53-b330-04ea17d8d40a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-21146689-a3a3-4b53-b330-04ea17d8d40a" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c6adda-3ddf-495d-b09d-34a9b5e4852b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:25 devstack sudo[93808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a
Nov 05 18:37:25 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:25 devstack sudo[93812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:37:25 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:25 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a" returned: 0 in 0.429s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:25 devstack sudo[93816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a
Nov 05 18:37:25 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:25 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.346s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:37:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:37:26 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21146689-a3a3-4b53-b330-04ea17d8d40a" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-quobyte-21146689-a3a3-4b53-b330-04ea17d8d40a" released by "delete_volume" :: held 0.954s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Created reservations ['05ca8668-37e0-421f-822f-3852d5bd00c1', '8fc97b23-171a-4ee6-a8bb-977d95864bd2', 'b5d8138a-704b-4850-ac2e-00c643cedc7f', 'ad2f5480-1280-403b-811d-62893070cae7'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:26 devstack sudo[93821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:37:26 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:26 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.455s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:37:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Deleted volume successfully.
Nov 05 18:37:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8972142f-5873-4b38-8d87-30cf22e5b542 tempest-VolumesSnapshotTestJSON-1187972809 None] Lock "cinder-21146689-a3a3-4b53-b330-04ea17d8d40a-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Flow 'volume_create_manager' (f17e0dc3-ebff-4a1e-811f-147bb33b0565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba9d487-ac9b-4375-85a7-71c8f87f673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba9d487-ac9b-4375-85a7-71c8f87f673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-324675658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955b7a31-1ad6-4501-9fe3-2e996006aa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36aef0224ffc42c2a2ab959eb1c0193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:30Z,use_quota=True,user_id='fcf044385aa84e558a3f4f462e147eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781eb2ab-ad4b-4f11-9b0b-45ab2e267e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781eb2ab-ad4b-4f11-9b0b-45ab2e267e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba87ab3-118b-4e16-9661-cbce5e7d1718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba87ab3-118b-4e16-9661-cbce5e7d1718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '955b7a31-1ad6-4501-9fe3-2e996006aa12', 'volume_name': 'volume-955b7a31-1ad6-4501-9fe3-2e996006aa12', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0916b5-8fc8-489a-9ab7-d28b1f586778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0916b5-8fc8-489a-9ab7-d28b1f586778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae04308-ea58-48e0-8a19-3f801490bd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:30 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Volume 955b7a31-1ad6-4501-9fe3-2e996006aa12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-955b7a31-1ad6-4501-9fe3-2e996006aa12', 'volume_size': 1}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-324675658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955b7a31-1ad6-4501-9fe3-2e996006aa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36aef0224ffc42c2a2ab959eb1c0193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:30Z,use_quota=True,user_id='fcf044385aa84e558a3f4f462e147eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Creating volume 955b7a31-1ad6-4501-9fe3-2e996006aa12 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:37:30 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:37:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:30 devstack sudo[93935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12 1073741824
Nov 05 18:37:30 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:31 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12 1073741824" returned: 0 in 1.071s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:32 devstack sudo[93943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12
Nov 05 18:37:32 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:32 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12" returned: 0 in 0.395s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:37:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae04308-ea58-48e0-8a19-3f801490bd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955b7a31-1ad6-4501-9fe3-2e996006aa12', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca778f96-cc02-4ff7-8d47-7b2b142439ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:32 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Volume volume-955b7a31-1ad6-4501-9fe3-2e996006aa12 (955b7a31-1ad6-4501-9fe3-2e996006aa12): created successfully
Nov 05 18:37:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca778f96-cc02-4ff7-8d47-7b2b142439ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Flow 'volume_create_manager' (f17e0dc3-ebff-4a1e-811f-147bb33b0565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-355898e6-1b34-47ee-91df-78adbe8ed858 tempest-AttachVolumeTestJSON-1909145057 None] Created volume successfully.
Nov 05 18:37:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-68640458-5a21-4760-b2bb-1f97962d7557 req-100539b9-1a35-404f-b926-a615870ab89f tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-68640458-5a21-4760-b2bb-1f97962d7557 req-100539b9-1a35-404f-b926-a615870ab89f tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-68640458-5a21-4760-b2bb-1f97962d7557 req-100539b9-1a35-404f-b926-a615870ab89f tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-68640458-5a21-4760-b2bb-1f97962d7557 req-100539b9-1a35-404f-b926-a615870ab89f tempest-AttachVolumeTestJSON-1909145057 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-955b7a31-1ad6-4501-9fe3-2e996006aa12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd79fc5f0-6406-4503-927c-5351fe764899', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:37:35 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-68640458-5a21-4760-b2bb-1f97962d7557 req-100539b9-1a35-404f-b926-a615870ab89f tempest-AttachVolumeTestJSON-1909145057 None] attachment_update completed successfully.
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Flow 'volume_create_manager' (8b1b664a-baa2-43e7-a62d-0fb1f7bf89f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5804d5ac-fcfe-459a-b334-b332393f79a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5804d5ac-fcfe-459a-b334-b332393f79a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1800935288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f301a4-33ea-48ef-a434-2843984ae839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36aef0224ffc42c2a2ab959eb1c0193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:40Z,use_quota=True,user_id='fcf044385aa84e558a3f4f462e147eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39151392-5448-4bc9-88ce-d160f4fb67be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39151392-5448-4bc9-88ce-d160f4fb67be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2676ff11-a441-47d7-97ce-c0e6a86536f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2676ff11-a441-47d7-97ce-c0e6a86536f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f301a4-33ea-48ef-a434-2843984ae839', 'volume_name': 'volume-37f301a4-33ea-48ef-a434-2843984ae839', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d651c3-a6ba-415d-a910-3e584a056331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d651c3-a6ba-415d-a910-3e584a056331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa374770-0212-43bd-be6d-40cf1f07ed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:40 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Volume 37f301a4-33ea-48ef-a434-2843984ae839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f301a4-33ea-48ef-a434-2843984ae839', 'volume_size': 1}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1800935288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f301a4-33ea-48ef-a434-2843984ae839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36aef0224ffc42c2a2ab959eb1c0193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:40Z,use_quota=True,user_id='fcf044385aa84e558a3f4f462e147eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Creating volume 37f301a4-33ea-48ef-a434-2843984ae839 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:37:40 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:37:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:40 devstack sudo[94453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839 1073741824
Nov 05 18:37:40 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:41 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839 1073741824" returned: 0 in 1.075s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:41 devstack sudo[94462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839
Nov 05 18:37:41 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:41 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839" returned: 0 in 0.409s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:37:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa374770-0212-43bd-be6d-40cf1f07ed8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f301a4-33ea-48ef-a434-2843984ae839', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53469bb1-3845-42c3-94f8-a3aa9f168845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:42 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Volume volume-37f301a4-33ea-48ef-a434-2843984ae839 (37f301a4-33ea-48ef-a434-2843984ae839): created successfully
Nov 05 18:37:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53469bb1-3845-42c3-94f8-a3aa9f168845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Flow 'volume_create_manager' (8b1b664a-baa2-43e7-a62d-0fb1f7bf89f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:42 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b7b5f9b9-e3da-455b-9469-c3025100661a tempest-AttachVolumeTestJSON-1909145057 None] Created volume successfully.
Nov 05 18:37:42 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:37:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Flow 'volume_create_manager' (08248137-4cf8-47ba-a40a-038af9e5a932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d21e320-6623-4631-b0f3-b0cad7420b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d21e320-6623-4631-b0f3-b0cad7420b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2064397707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b2e93a-d7fa-4325-b1e3-ea868233b32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0610a29268bf4f2bae743895d5ad3fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:42Z,use_quota=True,user_id='512d264d79324cac885cff2835d8365e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9b3703-8594-49f0-b3e2-a0aabb951873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9b3703-8594-49f0-b3e2-a0aabb951873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6d3f3f-4a9c-4f74-a597-ea87e2d6f9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6d3f3f-4a9c-4f74-a597-ea87e2d6f9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63b2e93a-d7fa-4325-b1e3-ea868233b32a', 'volume_name': 'volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72e5d02-513e-4c72-b1fa-fe5a12d4c906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72e5d02-513e-4c72-b1fa-fe5a12d4c906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e81ed1e-5f40-405a-8f2d-26449517b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:43 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Volume 63b2e93a-d7fa-4325-b1e3-ea868233b32a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a', 'volume_size': 1}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2064397707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63b2e93a-d7fa-4325-b1e3-ea868233b32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0610a29268bf4f2bae743895d5ad3fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:42Z,use_quota=True,user_id='512d264d79324cac885cff2835d8365e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Creating volume 63b2e93a-d7fa-4325-b1e3-ea868233b32a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:37:43 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:37:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:43 devstack sudo[94479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a 1073741824
Nov 05 18:37:43 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:44 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a 1073741824" returned: 0 in 1.133s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:44 devstack sudo[94528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a
Nov 05 18:37:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-72e96bb8-9bed-49c0-953b-efd14bb5f884 req-d060b887-42f4-421b-9848-78a932f20bad tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:44 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:45 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a" returned: 0 in 0.507s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-72e96bb8-9bed-49c0-953b-efd14bb5f884 req-d060b887-42f4-421b-9848-78a932f20bad tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.394s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e81ed1e-5f40-405a-8f2d-26449517b167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b88d23-bf95-410d-a51a-80ad25e62fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-72e96bb8-9bed-49c0-953b-efd14bb5f884 req-d060b887-42f4-421b-9848-78a932f20bad tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:45 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Volume volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a (63b2e93a-d7fa-4325-b1e3-ea868233b32a): created successfully
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b88d23-bf95-410d-a51a-80ad25e62fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Flow 'volume_create_manager' (08248137-4cf8-47ba-a40a-038af9e5a932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-5948f77a-054c-4515-a423-c211662cef43 req-4be24236-ae74-47d4-9525-4318b30c2c02 tempest-VolumesSnapshotsTestJSON-1631008211 None] Created volume successfully.
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-72e96bb8-9bed-49c0-953b-efd14bb5f884 req-d060b887-42f4-421b-9848-78a932f20bad tempest-AttachVolumeTestJSON-1909145057 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-37f301a4-33ea-48ef-a434-2843984ae839', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbc3e46f-7634-4459-81c2-2de7c7b86f08', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:37:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-72e96bb8-9bed-49c0-953b-efd14bb5f884 req-d060b887-42f4-421b-9848-78a932f20bad tempest-AttachVolumeTestJSON-1909145057 None] attachment_update completed successfully.
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Flow 'volume_create_manager' (bfa723a1-0d3f-4db6-be15-14324ef7bc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf33ac4-1aab-498f-9c56-bb239de44a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf33ac4-1aab-498f-9c56-bb239de44a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2089399741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6ebac2-b7e0-49ab-bb86-26110a7e0950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1db6126c2e41d3884ac5a0f96981e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:46Z,use_quota=True,user_id='cbd615e975e34d858eccc675df79b9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ebd34d-6d32-4571-99e2-ed0210ca5493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ebd34d-6d32-4571-99e2-ed0210ca5493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f92ad67-18fd-41e5-a0d9-f1370c0abbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f92ad67-18fd-41e5-a0d9-f1370c0abbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6ebac2-b7e0-49ab-bb86-26110a7e0950', 'volume_name': 'volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3309b3-7c90-4d06-b118-e42fe1d60b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3309b3-7c90-4d06-b118-e42fe1d60b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad625cd2-6d8f-49e3-910b-5deb0a6249d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:46 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Volume 8f6ebac2-b7e0-49ab-bb86-26110a7e0950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950', 'volume_size': 1}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2089399741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6ebac2-b7e0-49ab-bb86-26110a7e0950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1db6126c2e41d3884ac5a0f96981e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:46Z,use_quota=True,user_id='cbd615e975e34d858eccc675df79b9af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Creating volume 8f6ebac2-b7e0-49ab-bb86-26110a7e0950 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:37:46 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:46 devstack sudo[94541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950 1073741824
Nov 05 18:37:46 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:46 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950 1073741824" returned: 0 in 0.655s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:46 devstack sudo[94547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950
Nov 05 18:37:46 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:47 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950" returned: 0 in 0.334s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.965s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Creating offline snapshot cb0e0c85-0a0e-471e-839b-50afb999413e of volume 63b2e93a-d7fa-4325-b1e3-ea868233b32a {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad625cd2-6d8f-49e3-910b-5deb0a6249d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f915b4-512d-46ae-ae51-c0af986b6f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee9de34-8a6f-456a-9fab-6213674715ba]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:47 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Volume volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950 (8f6ebac2-b7e0-49ab-bb86-26110a7e0950): created successfully
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f915b4-512d-46ae-ae51-c0af986b6f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Flow 'volume_create_manager' (bfa723a1-0d3f-4db6-be15-14324ef7bc79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-07653203-7ae4-4f72-a820-17d6092702d2 tempest-ServerRescueNegativeTestJSON-1218265905 None] Created volume successfully.
Nov 05 18:37:47 devstack sudo[94552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a
Nov 05 18:37:47 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:47 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a" returned: 0 in 0.550s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:47 devstack sudo[94558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e 1G
Nov 05 18:37:47 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:48 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-4fdd209e-26bc-4020-ae4f-7fe1046c233c req-48c4c345-70a4-41eb-8eaf-93604d65de23 tempest-AttachVolumeTestJSON-1909145057 None] Terminate volume connection completed successfully.
Nov 05 18:37:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-4fdd209e-26bc-4020-ae4f-7fe1046c233c req-48c4c345-70a4-41eb-8eaf-93604d65de23 tempest-AttachVolumeTestJSON-1909145057 None] Deleting attachment d79fc5f0-6406-4503-927c-5351fe764899. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:37:48 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e 1G" returned: 0 in 0.968s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:48 devstack sudo[94567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e
Nov 05 18:37:48 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:49 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e" returned: 0 in 0.449s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:49 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e is being set with open permissions: ugo+rw
Nov 05 18:37:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:49 devstack sudo[94573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e
Nov 05 18:37:49 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:49 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e" returned: 0 in 0.595s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:37:50 devstack sudo[94607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.info
Nov 05 18:37:50 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Flow 'volume_create_manager' (39d23ad1-d6d7-4266-a5fe-aa0aafd2d03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca3b1fb-a961-43fe-9f83-d58743691d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca3b1fb-a961-43fe-9f83-d58743691d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1740886786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ada464-da70-421a-9307-90b9402adeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896b298a72f04d0287ac70485c231236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:50Z,use_quota=True,user_id='1757406b32864aa0bf3c7d5c27f67b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbe17e1-dee6-4f92-b3ee-2bb3ac5c95f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbe17e1-dee6-4f92-b3ee-2bb3ac5c95f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857c7fd3-5e01-418b-b504-53ae17d15c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857c7fd3-5e01-418b-b504-53ae17d15c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ada464-da70-421a-9307-90b9402adeef', 'volume_name': 'volume-48ada464-da70-421a-9307-90b9402adeef', 'volume_size': 2}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a9ffc8-adc5-4c28-8713-cf02c9724d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a9ffc8-adc5-4c28-8713-cf02c9724d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5028a346-8cc6-4578-964a-0e8224a78fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:50 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Volume 48ada464-da70-421a-9307-90b9402adeef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ada464-da70-421a-9307-90b9402adeef', 'volume_size': 2}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:50 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-df46b979-c4b9-4660-9516-49db44fd72a9 req-fcb28753-240e-4834-9eaa-b39dcfafe097 tempest-AttachVolumeTestJSON-1909145057 None] Terminate volume connection completed successfully.
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-df46b979-c4b9-4660-9516-49db44fd72a9 req-fcb28753-240e-4834-9eaa-b39dcfafe097 tempest-AttachVolumeTestJSON-1909145057 None] Deleting attachment dbc3e46f-7634-4459-81c2-2de7c7b86f08. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:37:50 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.info" returned: 0 in 0.544s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:50 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.info is being set with open permissions: ugo+rw
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:50 devstack sudo[94617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.info
Nov 05 18:37:50 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:50 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.info" returned: 0 in 0.394s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.794s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1740886786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ada464-da70-421a-9307-90b9402adeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896b298a72f04d0287ac70485c231236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:37:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:37:50Z,use_quota=True,user_id='1757406b32864aa0bf3c7d5c27f67b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Creating volume 48ada464-da70-421a-9307-90b9402adeef {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:37:50 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:37:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef 2147483648 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:51 devstack sudo[94633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef 2147483648
Nov 05 18:37:51 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:51 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-7db005f8-a7af-4c83-95ae-021a22bab62a req-262db3d4-a8cc-4cf8-87a0-8c13ec86f134 tempest-VolumesSnapshotsTestJSON-1631008211 None] Create snapshot completed successfully
Nov 05 18:37:51 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef 2147483648" returned: 0 in 1.005s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:52 devstack sudo[94666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef
Nov 05 18:37:52 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Acquiring lock "cinder-cb0e0c85-0a0e-471e-839b-50afb999413e-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "cinder-cb0e0c85-0a0e-471e-839b-50afb999413e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Acquiring lock "cinder-quobyte-63b2e93a-d7fa-4325-b1e3-ea868233b32a" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "cinder-quobyte-63b2e93a-d7fa-4325-b1e3-ea868233b32a" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Acquiring lock "cinder-quobyte-cb0e0c85-0a0e-471e-839b-50afb999413e" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "cinder-quobyte-cb0e0c85-0a0e-471e-839b-50afb999413e" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Deleting offline snapshot cb0e0c85-0a0e-471e-839b-50afb999413e of volume 63b2e93a-d7fa-4325-b1e3-ea868233b32a {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] snapshot_file for this snap is: volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c539c2-8ab4-40d8-a39e-57a356ee2905]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:52 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef" returned: 0 in 0.637s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5028a346-8cc6-4578-964a-0e8224a78fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ada464-da70-421a-9307-90b9402adeef', 'volume_size': 2}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e45ac31-cbb4-4d1f-bb32-507b98f91d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:37:52 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Volume volume-48ada464-da70-421a-9307-90b9402adeef (48ada464-da70-421a-9307-90b9402adeef): created successfully
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e45ac31-cbb4-4d1f-bb32-507b98f91d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:37:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Flow 'volume_create_manager' (39d23ad1-d6d7-4266-a5fe-aa0aafd2d03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:37:52 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9d00c155-e49a-45b5-8a69-56ae7214351f tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Created volume successfully.
Nov 05 18:37:52 devstack sudo[94674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e
Nov 05 18:37:52 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:53 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e" returned: 0 in 1.034s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:37:53 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1f0b0c-3d6c-481a-81fc-a8ea26ce0ea8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:53 devstack sudo[94680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a
Nov 05 18:37:53 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Creating offline snapshot e799a8c2-5775-4a16-9230-d0c594b1fa20 of volume 48ada464-da70-421a-9307-90b9402adeef {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:37:53 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b61223f-c565-47d0-aa78-8a52dd89fd77]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:54 devstack sudo[94682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef
Nov 05 18:37:54 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:54 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a" returned: 0 in 0.857s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:54 devstack sudo[94690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e
Nov 05 18:37:54 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:54 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef" returned: 0 in 0.768s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20 2G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:54 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20 2G
Nov 05 18:37:54 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:55 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e" returned: 0 in 1.230s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:55 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20 2G" returned: 0 in 1.113s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ada464-da70-421a-9307-90b9402adeef -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:55 devstack sudo[94708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e
Nov 05 18:37:55 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:55 devstack sudo[94710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ada464-da70-421a-9307-90b9402adeef -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20
Nov 05 18:37:55 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:56 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ada464-da70-421a-9307-90b9402adeef -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20" returned: 0 in 0.636s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:56 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20 is being set with open permissions: ugo+rw
Nov 05 18:37:56 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a.cb0e0c85-0a0e-471e-839b-50afb999413e" returned: 0 in 0.728s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:56 devstack sudo[94743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20
Nov 05 18:37:56 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "cinder-quobyte-cb0e0c85-0a0e-471e-839b-50afb999413e" released by "_delete_snapshot" :: held 4.109s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "cinder-quobyte-63b2e93a-d7fa-4325-b1e3-ea868233b32a" released by "delete_snapshot" :: held 4.182s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:56 devstack cinder-volume[87086]: DEBUG cinder.quota [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Created reservations ['efb9e36d-f360-4ed9-91cb-0a70fc37ebf8', '1d906e40-88f5-491d-9b16-1b026740deab', '017e21a7-a8ba-4d3f-944a-ad8d4cb6b16b', 'e3375fed-65ef-4f21-a723-f6580251297e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:37:56 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20" returned: 0 in 0.418s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Delete snapshot completed successfully.
Nov 05 18:37:56 devstack sudo[94747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.info
Nov 05 18:37:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-494d2025-f56d-41a8-a5f5-4d78c8eaca41 req-468333c2-d600-414a-8a4f-62c8f7d48a80 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "cinder-cb0e0c85-0a0e-471e-839b-50afb999413e-delete_snapshot" released by "delete_snapshot" :: held 4.606s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:56 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:57 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.info" returned: 0 in 0.347s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:57 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.info is being set with open permissions: ugo+rw
Nov 05 18:37:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:57 devstack sudo[94770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.info
Nov 05 18:37:57 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Acquiring lock "cinder-63b2e93a-d7fa-4325-b1e3-ea868233b32a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "cinder-63b2e93a-d7fa-4325-b1e3-ea868233b32a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Acquiring lock "cinder-quobyte-63b2e93a-d7fa-4325-b1e3-ea868233b32a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "cinder-quobyte-63b2e93a-d7fa-4325-b1e3-ea868233b32a" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:57 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.info" returned: 0 in 0.480s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.993s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:57 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a73eff-a639-4f22-9201-6c7dce95330f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:57 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-09120af8-eed6-4403-8a1c-493aabd2bc5c tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Create snapshot completed successfully
Nov 05 18:37:57 devstack sudo[94780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a
Nov 05 18:37:57 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Acquiring lock "cinder-e799a8c2-5775-4a16-9230-d0c594b1fa20-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "cinder-e799a8c2-5775-4a16-9230-d0c594b1fa20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Acquiring lock "cinder-quobyte-48ada464-da70-421a-9307-90b9402adeef" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:58 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "cinder-quobyte-48ada464-da70-421a-9307-90b9402adeef" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Acquiring lock "cinder-quobyte-e799a8c2-5775-4a16-9230-d0c594b1fa20" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a" returned: 0 in 0.543s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "cinder-quobyte-e799a8c2-5775-4a16-9230-d0c594b1fa20" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:58 devstack sudo[94785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a
Nov 05 18:37:58 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Deleting offline snapshot e799a8c2-5775-4a16-9230-d0c594b1fa20 of volume 48ada464-da70-421a-9307-90b9402adeef {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] snapshot_file for this snap is: volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f920f-8070-4b89-817c-282385fd10de]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "cinder-37f301a4-33ea-48ef-a434-2843984ae839-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-37f301a4-33ea-48ef-a434-2843984ae839-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "cinder-quobyte-37f301a4-33ea-48ef-a434-2843984ae839" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:58 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-63b2e93a-d7fa-4325-b1e3-ea868233b32a" returned: 0 in 0.396s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-quobyte-37f301a4-33ea-48ef-a434-2843984ae839" acquired by "delete_volume" :: waited 0.054s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:58 devstack sudo[94788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20
Nov 05 18:37:58 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "cinder-quobyte-63b2e93a-d7fa-4325-b1e3-ea868233b32a" released by "delete_volume" :: held 1.114s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c363c0d8-d6f8-4e77-b739-b864b023e5aa]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:58 devstack cinder-volume[87086]: DEBUG cinder.quota [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Created reservations ['b3291239-b517-494b-af78-f0b85901a06b', '353a405f-cdac-4557-9e4c-e3392cac8620', '50203e3b-c1cf-42e2-ac6d-a4059e0654cd', 'c6f18060-29ad-43e7-9e63-ca82381b0bdb'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:37:59 devstack sudo[94791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839
Nov 05 18:37:59 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:59 devstack sudo[94797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:37:59 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:59 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Acquiring lock "cinder-8f6ebac2-b7e0-49ab-bb86-26110a7e0950-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20" returned: 0 in 0.785s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ada464-da70-421a-9307-90b9402adeef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Lock "cinder-8f6ebac2-b7e0-49ab-bb86-26110a7e0950-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02e8915-cfc5-4f99-814e-014cc4ca0d5f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Acquiring lock "cinder-quobyte-8f6ebac2-b7e0-49ab-bb86-26110a7e0950" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Lock "cinder-quobyte-8f6ebac2-b7e0-49ab-bb86-26110a7e0950" acquired by "delete_volume" :: waited 0.029s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b544755f-198b-4a6c-aba4-2bc75a54188f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:59 devstack sudo[94799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef
Nov 05 18:37:59 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:59 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839" returned: 0 in 0.716s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:37:59 devstack sudo[94806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839
Nov 05 18:37:59 devstack sudo[94803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950
Nov 05 18:37:59 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:59 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:37:59 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.473s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG cinder.manager [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:37:59 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Deleted volume successfully.
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-90e82074-24d1-4747-ad65-773e9b4381d6 req-b941b96d-eedf-413a-927c-85e8e71e77a4 tempest-VolumesSnapshotsTestJSON-1631008211 None] Lock "cinder-63b2e93a-d7fa-4325-b1e3-ea868233b32a-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:37:59 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef" returned: 0 in 0.645s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:37:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:00 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37f301a4-33ea-48ef-a434-2843984ae839" returned: 0 in 0.449s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:00 devstack sudo[94816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20
Nov 05 18:38:00 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-quobyte-37f301a4-33ea-48ef-a434-2843984ae839" released by "delete_volume" :: held 1.282s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:00 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950" returned: 0 in 0.625s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:00 devstack sudo[94819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950
Nov 05 18:38:00 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Created reservations ['e5e649e4-b700-46c0-ac77-c4f1578e5669', '05936673-66a7-438e-a859-c59168a8f086', '0eeb8964-9e33-48ea-b4ee-12b11f79419b', '0b2c7978-3fd3-44e1-aa59-7490f52db866'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:00 devstack sudo[94823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:38:00 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:00 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8f6ebac2-b7e0-49ab-bb86-26110a7e0950" returned: 0 in 0.425s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Lock "cinder-quobyte-8f6ebac2-b7e0-49ab-bb86-26110a7e0950" released by "delete_volume" :: held 1.138s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:00 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20" returned: 0 in 0.644s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:00 devstack sudo[94828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20
Nov 05 18:38:00 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Created reservations ['ff4186fc-08f8-47ce-80cb-83548345f0c8', 'cce351d9-092e-40b8-98fd-2395e920a5ac', '87d309e8-ff30-4738-b2e7-b7c704dae31a', 'bc355cff-a0df-4c58-9c3d-d488de72b60d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:00 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.400s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:38:00 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Deleted volume successfully.
Nov 05 18:38:00 devstack sudo[94831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:38:00 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0bddc365-d7cb-4bba-aa27-a8689e01aad8 tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-37f301a4-33ea-48ef-a434-2843984ae839-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "cinder-955b7a31-1ad6-4501-9fe3-2e996006aa12-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-955b7a31-1ad6-4501-9fe3-2e996006aa12-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "cinder-quobyte-955b7a31-1ad6-4501-9fe3-2e996006aa12" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-quobyte-955b7a31-1ad6-4501-9fe3-2e996006aa12" acquired by "delete_volume" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[95081255-da22-4c4f-b531-910d41fbbbd8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:01 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef.e799a8c2-5775-4a16-9230-d0c594b1fa20" returned: 0 in 0.511s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "cinder-quobyte-e799a8c2-5775-4a16-9230-d0c594b1fa20" released by "_delete_snapshot" :: held 2.858s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "cinder-quobyte-48ada464-da70-421a-9307-90b9402adeef" released by "delete_snapshot" :: held 2.908s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:01 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.509s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:38:01 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Deleted volume successfully.
Nov 05 18:38:01 devstack sudo[94834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12
Nov 05 18:38:01 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7214aaa7-e876-4693-a66a-53909e96d504 tempest-ServerRescueNegativeTestJSON-1218265905 None] Lock "cinder-8f6ebac2-b7e0-49ab-bb86-26110a7e0950-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Created reservations ['cd110803-86f0-4977-8b33-5e073eff0a11', '771e6415-5bf9-45f7-8e24-60462efb8dd9', 'de408917-c5ba-466d-a7bd-01f3cb8ffa17', 'e88ca237-b2b2-4911-972b-959d6b2b470a'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:01 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Delete snapshot completed successfully.
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5de1c459-e29f-47d6-87e1-06da2f91a21d tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "cinder-e799a8c2-5775-4a16-9230-d0c594b1fa20-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Acquiring lock "cinder-48ada464-da70-421a-9307-90b9402adeef-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "cinder-48ada464-da70-421a-9307-90b9402adeef-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:01 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12" returned: 0 in 0.691s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Acquiring lock "cinder-quobyte-48ada464-da70-421a-9307-90b9402adeef" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:01 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12
Nov 05 18:38:01 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "cinder-quobyte-48ada464-da70-421a-9307-90b9402adeef" acquired by "delete_volume" :: waited 0.060s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d3203a-5e00-4e80-89ae-47a767dede45]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:02 devstack sudo[94844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef
Nov 05 18:38:02 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:02 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-955b7a31-1ad6-4501-9fe3-2e996006aa12" returned: 0 in 0.642s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-quobyte-955b7a31-1ad6-4501-9fe3-2e996006aa12" released by "delete_volume" :: held 1.464s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Created reservations ['e07a0e92-3bfb-4303-a55e-acba0a9197fb', '11e1cbe0-b21d-4635-8123-0d81d6370510', 'df60714f-4df1-4cce-8ed9-46ce32bcacc0', 'd6e38126-5a9a-4825-ac5c-c613fb577500'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:02 devstack sudo[94871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:38:02 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:02 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef" returned: 0 in 0.915s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:03 devstack sudo[94876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef
Nov 05 18:38:03 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:03 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.447s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:38:03 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Deleted volume successfully.
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6f733667-03e5-4f65-a74a-ea105d4bc5df tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-955b7a31-1ad6-4501-9fe3-2e996006aa12-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:03 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-48ada464-da70-421a-9307-90b9402adeef" returned: 0 in 0.530s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "cinder-quobyte-48ada464-da70-421a-9307-90b9402adeef" released by "delete_volume" :: held 1.626s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "cinder-5c8ac22c-b5d0-4582-beac-f43c7554deeb-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Created reservations ['19b45c31-da20-42a6-aa00-bdc50ab21aa5', 'f3df8492-e37c-490d-9c17-c06c0a96f592', '07b5dfc4-8d46-4aaa-bdfb-b0dd5b030a47', '7decb2e2-0bb4-4b7b-8ead-259b8a978554'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-5c8ac22c-b5d0-4582-beac-f43c7554deeb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "cinder-quobyte-5c8ac22c-b5d0-4582-beac-f43c7554deeb" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-quobyte-5c8ac22c-b5d0-4582-beac-f43c7554deeb" acquired by "delete_volume" :: waited 0.047s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cdc719-4fc5-4f1a-b814-a359f3d6b2d1]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:04 devstack sudo[94883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:38:04 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:04 devstack sudo[94882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb
Nov 05 18:38:04 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:04 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.588s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:04 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:38:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Deleted volume successfully.
Nov 05 18:38:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0245ff50-cf40-476f-ae6d-800450120987 tempest-VolumesSnapshotNegativeTestJSON-1889034064 None] Lock "cinder-48ada464-da70-421a-9307-90b9402adeef-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:04 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb" returned: 0 in 1.049s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:05 devstack sudo[94892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb
Nov 05 18:38:05 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:05 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c8ac22c-b5d0-4582-beac-f43c7554deeb" returned: 0 in 0.518s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-quobyte-5c8ac22c-b5d0-4582-beac-f43c7554deeb" released by "delete_volume" :: held 1.654s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:05 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Created reservations ['0d07a82a-2aeb-40a1-be9b-7c9b84ea8567', 'bb6cb208-3a8c-42bd-829c-68d0e4ae0de5', '99fe4732-d79f-434e-b16e-e1c55f2fb44b', 'ddfffb3d-88d0-4f4c-a66e-dbd7f6bdf8bb'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:05 devstack sudo[94896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:38:05 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:06 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.356s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:06 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:38:06 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Deleted volume successfully.
Nov 05 18:38:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b2ad430e-c04f-436e-90ad-5900b0af7c85 tempest-AttachVolumeTestJSON-1909145057 None] Lock "cinder-5c8ac22c-b5d0-4582-beac-f43c7554deeb-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Flow 'volume_create_manager' (e6b3070a-5c2e-4226-bd88-787678b7e0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ee579f-2fca-46db-8dce-6d3559cbb979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ee579f-2fca-46db-8dce-6d3559cbb979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1231274757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e998e7a1-3ecc-49aa-abd0-9d51d80c87de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1dce1e396fe44f92b989a194502f970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:38:08Z,use_quota=True,user_id='2bf10f882c6d4de68f1e11e901579dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab806f8-4409-4a22-9df1-019e4ed4b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab806f8-4409-4a22-9df1-019e4ed4b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1af5af5-fa02-45ff-b585-1d7906370375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1af5af5-fa02-45ff-b585-1d7906370375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e998e7a1-3ecc-49aa-abd0-9d51d80c87de', 'volume_name': 'volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdca72e4-62cb-40a8-8616-cc6876009068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdca72e4-62cb-40a8-8616-cc6876009068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db748c6e-8a75-430b-8f15-ba18781af2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:08 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Volume e998e7a1-3ecc-49aa-abd0-9d51d80c87de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de', 'volume_size': 1}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1231274757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e998e7a1-3ecc-49aa-abd0-9d51d80c87de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1dce1e396fe44f92b989a194502f970a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:38:08Z,use_quota=True,user_id='2bf10f882c6d4de68f1e11e901579dc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Creating volume e998e7a1-3ecc-49aa-abd0-9d51d80c87de {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:38:08 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:38:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:08 devstack sudo[94922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de 1073741824
Nov 05 18:38:08 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:09 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de 1073741824" returned: 0 in 0.620s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:09 devstack sudo[94929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de
Nov 05 18:38:09 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:09 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de" returned: 0 in 0.362s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:38:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db748c6e-8a75-430b-8f15-ba18781af2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (837ae377-03e3-455f-9180-e8dae34c12a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:09 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Volume volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de (e998e7a1-3ecc-49aa-abd0-9d51d80c87de): created successfully
Nov 05 18:38:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (837ae377-03e3-455f-9180-e8dae34c12a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Flow 'volume_create_manager' (e6b3070a-5c2e-4226-bd88-787678b7e0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:38:09 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-51be8284-5e87-415b-8785-e1450aecfdb0 req-a409978b-09aa-4220-bf34-277df8480eed tempest-VolumesGetTestJSON-1186828720 None] Created volume successfully.
Nov 05 18:38:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Acquiring lock "cinder-e998e7a1-3ecc-49aa-abd0-9d51d80c87de-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Lock "cinder-e998e7a1-3ecc-49aa-abd0-9d51d80c87de-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Acquiring lock "cinder-quobyte-e998e7a1-3ecc-49aa-abd0-9d51d80c87de" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Lock "cinder-quobyte-e998e7a1-3ecc-49aa-abd0-9d51d80c87de" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:11 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[6639af82-4b1c-4025-9732-8278af8a2920]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:38:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:11 devstack sudo[94932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de
Nov 05 18:38:11 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:11 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de" returned: 0 in 0.420s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:11 devstack sudo[94937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de
Nov 05 18:38:11 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:12 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e998e7a1-3ecc-49aa-abd0-9d51d80c87de" returned: 0 in 0.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Lock "cinder-quobyte-e998e7a1-3ecc-49aa-abd0-9d51d80c87de" released by "delete_volume" :: held 0.783s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG cinder.quota [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Created reservations ['9bf61ec2-3500-482e-9011-25844bcd0cca', '4f3b058c-372b-4355-883e-05143025af3e', '012b4b6d-0d74-4c19-956a-3eafee52d186', '009c3355-5a33-4949-932d-cdb5b82a8681'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:12 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:38:12 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:12 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.314s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG cinder.manager [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:38:12 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Deleted volume successfully.
Nov 05 18:38:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-52a8d46e-2ebf-4a0b-8e95-cb055f877a9c req-165c123b-bdc3-4d47-a2c9-3204bcb0258a tempest-VolumesGetTestJSON-1186828720 None] Lock "cinder-e998e7a1-3ecc-49aa-abd0-9d51d80c87de-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:22 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=99,cinder:INSERT=29,cinder:UPDATE=120,cinder:DELETE=12 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:38:22 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=102,cinder:INSERT=31,cinder:UPDATE=121,cinder:DELETE=6 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:25 devstack sudo[94948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:38:25 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:25 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.305s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:38:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:38:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1ef95980-e9e8-4aed-8a26-9cc0fef8eb9c tempest-GroupsTest-608647453 None] Group tempest-Group1-1277514426: creating
Nov 05 18:38:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1ef95980-e9e8-4aed-8a26-9cc0fef8eb9c tempest-GroupsTest-608647453 None] Group tempest-Group1-1277514426: created successfully
Nov 05 18:38:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1ef95980-e9e8-4aed-8a26-9cc0fef8eb9c tempest-GroupsTest-608647453 None] Create group completed successfully.
Nov 05 18:38:30 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ad241aca-cba2-427d-9ab9-9579f47c8192 tempest-GroupsTest-608647453 None] Group tempest-Group2-1720760192: creating
Nov 05 18:38:30 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ad241aca-cba2-427d-9ab9-9579f47c8192 tempest-GroupsTest-608647453 None] Group tempest-Group2-1720760192: created successfully
Nov 05 18:38:30 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ad241aca-cba2-427d-9ab9-9579f47c8192 tempest-GroupsTest-608647453 None] Create group completed successfully.
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Flow 'volume_create_manager' (e15066ad-0d74-4294-8b5d-569c21370490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95dcadb-05f8-41f0-a19c-2d235a009efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95dcadb-05f8-41f0-a19c-2d235a009efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-162330191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0aaee0f5-02d4-472f-b696-40c51e244785,host='devstack@QuobyteHD#QuobyteHD',id=80c84073-3504-481f-b131-9d1078311a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1efe17e084ce7aefda6ce16dbb580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:38:33Z,use_quota=True,user_id='02d9ca3b81524e83b6e45651a9c0a0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a474bfef-e41f-4cf9-98d0-aee19e37f9d1),volume_type_id=a474bfef-e41f-4cf9-98d0-aee19e37f9d1)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b7edf2-7452-49e4-8213-24708b379514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b7edf2-7452-49e4-8213-24708b379514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f6b904-95b5-4d91-b0c8-8308c1829c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f6b904-95b5-4d91-b0c8-8308c1829c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c84073-3504-481f-b131-9d1078311a5d', 'volume_name': 'volume-80c84073-3504-481f-b131-9d1078311a5d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1113d70-1687-44c8-b4e7-bfb6a9808e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1113d70-1687-44c8-b4e7-bfb6a9808e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd277aa6-6fa2-44a7-aa1c-b460a54e597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:32 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Volume 80c84073-3504-481f-b131-9d1078311a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c84073-3504-481f-b131-9d1078311a5d', 'volume_size': 1}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0aaee0f5-02d4-472f-b696-40c51e244785,created_at=2026-11-05T17:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-162330191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0aaee0f5-02d4-472f-b696-40c51e244785,host='devstack@QuobyteHD#QuobyteHD',id=80c84073-3504-481f-b131-9d1078311a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1efe17e084ce7aefda6ce16dbb580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:38:33Z,use_quota=True,user_id='02d9ca3b81524e83b6e45651a9c0a0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a474bfef-e41f-4cf9-98d0-aee19e37f9d1),volume_type_id=a474bfef-e41f-4cf9-98d0-aee19e37f9d1)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Creating volume 80c84073-3504-481f-b131-9d1078311a5d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:38:32 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:38:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:32 devstack sudo[94951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d 1073741824
Nov 05 18:38:32 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:33 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d 1073741824" returned: 0 in 0.542s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:33 devstack sudo[94956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d
Nov 05 18:38:33 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:33 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d" returned: 0 in 0.357s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:38:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd277aa6-6fa2-44a7-aa1c-b460a54e597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c84073-3504-481f-b131-9d1078311a5d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a099e17f-60a1-4349-9bec-a900f085ac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:33 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Volume volume-80c84073-3504-481f-b131-9d1078311a5d (80c84073-3504-481f-b131-9d1078311a5d): created successfully
Nov 05 18:38:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a099e17f-60a1-4349-9bec-a900f085ac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Flow 'volume_create_manager' (e15066ad-0d74-4294-8b5d-569c21370490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:38:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c868be40-954f-482b-8725-5190a95bdee4 tempest-GroupsTest-608647453 None] Created volume successfully.
Nov 05 18:38:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Acquiring lock "cinder-quobyte-80c84073-3504-481f-b131-9d1078311a5d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Lock "cinder-quobyte-80c84073-3504-481f-b131-9d1078311a5d" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:36 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77dfa2d-a5fc-4980-aac3-50d0dc82a7b0]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:38:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:36 devstack sudo[94961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d
Nov 05 18:38:36 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:36 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d" returned: 0 in 0.479s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:36 devstack sudo[94966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d
Nov 05 18:38:36 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:36 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-80c84073-3504-481f-b131-9d1078311a5d" returned: 0 in 0.282s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Lock "cinder-quobyte-80c84073-3504-481f-b131-9d1078311a5d" released by "delete_volume" :: held 0.851s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:36 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Created reservations ['887a788c-9cf0-4c74-b8a7-7145961d21a2'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:36 devstack cinder-volume[87086]: WARNING cinder.quota [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1999266530 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1999266530, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:38:36 devstack cinder-volume[87086]: WARNING cinder.quota [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1999266530 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1999266530, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Created reservations ['ebcec61d-c8fd-4db0-8bb5-0fa561e47692', 'ce890bc9-fa54-4c19-9435-d594f79264f6', '182d600c-8fb9-499b-ac52-c3aed0dc9e13', 'fd6c8379-7192-4a82-a17f-59ef72ba3691'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:37 devstack sudo[94971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:38:37 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-ac24706b-9b7d-4376-8ac0-c1dbbdea0415 tempest-GroupsTest-608647453 None] Created reservations ['6924f220-35cc-429a-bc7a-464138c4cacb'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:37 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.356s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:38:37 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-88c32b79-ca1e-438b-ab3e-15e88229765e tempest-GroupsTest-608647453 None] Delete group completed successfully.
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ac24706b-9b7d-4376-8ac0-c1dbbdea0415 tempest-GroupsTest-608647453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ac24706b-9b7d-4376-8ac0-c1dbbdea0415 tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ac24706b-9b7d-4376-8ac0-c1dbbdea0415 tempest-GroupsTest-608647453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ac24706b-9b7d-4376-8ac0-c1dbbdea0415 tempest-GroupsTest-608647453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ac24706b-9b7d-4376-8ac0-c1dbbdea0415 tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ac24706b-9b7d-4376-8ac0-c1dbbdea0415 tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:37 devstack sudo[94974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:38:37 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:37 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ac24706b-9b7d-4376-8ac0-c1dbbdea0415 tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.297s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:37 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-ac24706b-9b7d-4376-8ac0-c1dbbdea0415 tempest-GroupsTest-608647453 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:38:37 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ac24706b-9b7d-4376-8ac0-c1dbbdea0415 tempest-GroupsTest-608647453 None] Delete group completed successfully.
Nov 05 18:38:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c0afeac6-2601-410b-adca-ef00ffabf925 tempest-GroupsTest-608647453 None] Group tempest-GroupsTest-Group-1466646426: creating
Nov 05 18:38:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c0afeac6-2601-410b-adca-ef00ffabf925 tempest-GroupsTest-608647453 None] Group tempest-GroupsTest-Group-1466646426: created successfully
Nov 05 18:38:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c0afeac6-2601-410b-adca-ef00ffabf925 tempest-GroupsTest-608647453 None] Create group completed successfully.
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Flow 'volume_create_manager' (3be958e1-1f3d-4847-8165-f20e6b2a2e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb90bd73-0cca-4f66-90b0-ca5f639a0842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb90bd73-0cca-4f66-90b0-ca5f639a0842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1799832381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=53bc26e3-a73f-4473-a628-46d1b6d00feb,host='devstack@QuobyteHD#QuobyteHD',id=e3312611-558d-488f-9a49-162d05eb946d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1efe17e084ce7aefda6ce16dbb580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:38:41Z,use_quota=True,user_id='02d9ca3b81524e83b6e45651a9c0a0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3fd4323-b389-4da2-b4ed-c6caf9debdd1),volume_type_id=f3fd4323-b389-4da2-b4ed-c6caf9debdd1)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b60576c-19d0-432d-ab0c-7d8360bbd5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b60576c-19d0-432d-ab0c-7d8360bbd5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc9fd23-8507-4d65-829d-c90c1edbe9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc9fd23-8507-4d65-829d-c90c1edbe9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3312611-558d-488f-9a49-162d05eb946d', 'volume_name': 'volume-e3312611-558d-488f-9a49-162d05eb946d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c0db42-033e-4b2b-87e8-e3b4bf393586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c0db42-033e-4b2b-87e8-e3b4bf393586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0a0c3f-d37b-46ab-a79a-c0ebc3d7ad1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:41 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Volume e3312611-558d-488f-9a49-162d05eb946d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3312611-558d-488f-9a49-162d05eb946d', 'volume_size': 1}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=53bc26e3-a73f-4473-a628-46d1b6d00feb,created_at=2026-11-05T17:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1799832381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=53bc26e3-a73f-4473-a628-46d1b6d00feb,host='devstack@QuobyteHD#QuobyteHD',id=e3312611-558d-488f-9a49-162d05eb946d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1efe17e084ce7aefda6ce16dbb580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:38:41Z,use_quota=True,user_id='02d9ca3b81524e83b6e45651a9c0a0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3fd4323-b389-4da2-b4ed-c6caf9debdd1),volume_type_id=f3fd4323-b389-4da2-b4ed-c6caf9debdd1)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Creating volume e3312611-558d-488f-9a49-162d05eb946d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:38:41 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:41 devstack sudo[94977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d 1073741824
Nov 05 18:38:41 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:41 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d 1073741824" returned: 0 in 0.696s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:42 devstack sudo[95018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d
Nov 05 18:38:42 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:42 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d" returned: 0 in 0.301s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:38:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0a0c3f-d37b-46ab-a79a-c0ebc3d7ad1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3312611-558d-488f-9a49-162d05eb946d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9af2328-7022-4b82-a6a0-81ea8f59f9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:42 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Volume volume-e3312611-558d-488f-9a49-162d05eb946d (e3312611-558d-488f-9a49-162d05eb946d): created successfully
Nov 05 18:38:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9af2328-7022-4b82-a6a0-81ea8f59f9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Flow 'volume_create_manager' (3be958e1-1f3d-4847-8165-f20e6b2a2e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:38:42 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c170100c-f52c-4df4-8195-0a3fc1f3f2cf tempest-GroupsTest-608647453 None] Created volume successfully.
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Flow 'volume_create_manager' (f7852686-5740-4b1d-b39d-70fce87d4182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e90f477-7add-4820-9a33-54ada7da2faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e90f477-7add-4820-9a33-54ada7da2faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1084907719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=53bc26e3-a73f-4473-a628-46d1b6d00feb,host='devstack@QuobyteHD#QuobyteHD',id=1f89f7f0-d5e2-4d6b-82ec-19e513d57de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1efe17e084ce7aefda6ce16dbb580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:38:45Z,use_quota=True,user_id='02d9ca3b81524e83b6e45651a9c0a0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3fd4323-b389-4da2-b4ed-c6caf9debdd1),volume_type_id=f3fd4323-b389-4da2-b4ed-c6caf9debdd1)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01184c79-5aca-4b4d-9d09-816cfc228f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01184c79-5aca-4b4d-9d09-816cfc228f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c578c041-b298-49dd-962e-22aff24e7b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c578c041-b298-49dd-962e-22aff24e7b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f89f7f0-d5e2-4d6b-82ec-19e513d57de0', 'volume_name': 'volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97f4a60-a787-485b-83ba-4fbf5e130749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97f4a60-a787-485b-83ba-4fbf5e130749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea92f60-115e-41e8-8c6d-249412a7083d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:44 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Volume 1f89f7f0-d5e2-4d6b-82ec-19e513d57de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0', 'volume_size': 1}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=53bc26e3-a73f-4473-a628-46d1b6d00feb,created_at=2026-11-05T17:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1084907719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=53bc26e3-a73f-4473-a628-46d1b6d00feb,host='devstack@QuobyteHD#QuobyteHD',id=1f89f7f0-d5e2-4d6b-82ec-19e513d57de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22a1efe17e084ce7aefda6ce16dbb580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:38:45Z,use_quota=True,user_id='02d9ca3b81524e83b6e45651a9c0a0eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3fd4323-b389-4da2-b4ed-c6caf9debdd1),volume_type_id=f3fd4323-b389-4da2-b4ed-c6caf9debdd1)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Creating volume 1f89f7f0-d5e2-4d6b-82ec-19e513d57de0 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:38:44 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:38:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:44 devstack sudo[95033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0 1073741824
Nov 05 18:38:44 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:45 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0 1073741824" returned: 0 in 0.634s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:45 devstack sudo[95044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0
Nov 05 18:38:45 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:45 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0" returned: 0 in 0.345s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:38:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea92f60-115e-41e8-8c6d-249412a7083d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a803b8-c198-4a34-9cdf-e16e72d1c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:38:45 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Volume volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0 (1f89f7f0-d5e2-4d6b-82ec-19e513d57de0): created successfully
Nov 05 18:38:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a803b8-c198-4a34-9cdf-e16e72d1c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:38:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Flow 'volume_create_manager' (f7852686-5740-4b1d-b39d-70fce87d4182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:38:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-14a2400d-d846-457a-8b5f-4cee491ef01e tempest-GroupsTest-608647453 None] Created volume successfully.
Nov 05 18:38:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-cbef004e-1b3f-462f-8222-408759e0139c tempest-GroupsTest-608647453 None] Update group completed successfully.
Nov 05 18:38:49 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-19e853ab-56c7-41b0-90c4-5af89a5d86ec tempest-GroupsTest-608647453 None] Update group completed successfully.
Nov 05 18:38:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Acquiring lock "cinder-quobyte-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Lock "cinder-quobyte-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:50 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[31142c1d-e40b-4dcc-b7d8-acbc83b1ae94]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:38:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:51 devstack sudo[95082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0
Nov 05 18:38:51 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:51 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0" returned: 0 in 0.513s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:51 devstack sudo[95088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0
Nov 05 18:38:51 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:51 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0" returned: 0 in 0.519s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Lock "cinder-quobyte-1f89f7f0-d5e2-4d6b-82ec-19e513d57de0" released by "delete_volume" :: held 1.130s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Acquiring lock "cinder-quobyte-e3312611-558d-488f-9a49-162d05eb946d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:38:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Lock "cinder-quobyte-e3312611-558d-488f-9a49-162d05eb946d" acquired by "delete_volume" :: waited 0.046s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:38:52 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a510ea-61bf-4d2a-a3d2-b5f187dfb601]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:38:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:52 devstack sudo[95144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d
Nov 05 18:38:52 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:53 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d" returned: 0 in 0.983s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:53 devstack sudo[95176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d
Nov 05 18:38:53 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:53 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e3312611-558d-488f-9a49-162d05eb946d" returned: 0 in 0.919s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Lock "cinder-quobyte-e3312611-558d-488f-9a49-162d05eb946d" released by "delete_volume" :: held 2.007s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:38:54 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Created reservations ['7961cf6e-184e-403c-a3b0-711b95486e6d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:54 devstack cinder-volume[87086]: WARNING cinder.quota [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1437308447 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1437308447, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:38:54 devstack cinder-volume[87086]: WARNING cinder.quota [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1437308447 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1437308447, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:38:54 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Created reservations ['578a6a5a-6d7a-4a84-a087-477be41ac56a', '4417e6af-3e2b-46ab-afc7-b64bff4b1862', 'c9637511-b634-4c72-9e67-a0a57d637f52', '454af061-1a33-4aad-84d6-1bcd9f7d5d24'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:54 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Created reservations ['7ea0a9b2-c90e-4385-94b8-bb6b603775c1', '8a222e38-1cce-4f4c-a9a4-ffa2cb97c8d3', 'f50dee90-3deb-49a6-a551-2900c4c7da1b', '16dda873-5fb5-4fc2-b4b5-a18c5765c2f8'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:38:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:38:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:38:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:38:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:38:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:38:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:38:55 devstack sudo[95230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:38:55 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:38:55 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root
Nov 05 18:38:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.417s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:38:55 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:38:55 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c3d6f7d3-a61f-4ce0-b2cd-301a461a14cb tempest-GroupsTest-608647453 None] Delete group completed successfully.
Nov 05 18:39:05 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=42,cinder:UPDATE=47,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:39:05 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=40,cinder:UPDATE=44,cinder:INSERT=9 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:39:10 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ee6525d2-9b6a-458f-a7bc-f7cd06838b2b tempest-GroupsV320Test-1889715203 None] Group tempest-GroupsV320Test-Group-181184385: creating
Nov 05 18:39:10 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ee6525d2-9b6a-458f-a7bc-f7cd06838b2b tempest-GroupsV320Test-1889715203 None] Group tempest-GroupsV320Test-Group-181184385: created successfully
Nov 05 18:39:10 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ee6525d2-9b6a-458f-a7bc-f7cd06838b2b tempest-GroupsV320Test-1889715203 None] Create group completed successfully.
Nov 05 18:39:11 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-3617d007-879a-4a15-a498-ce9b31221776 tempest-GroupsV320Test-1889715203 None] Created reservations ['d69f0d47-097a-46ba-bc7f-a999b6b80bb5'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:39:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3617d007-879a-4a15-a498-ce9b31221776 tempest-GroupsV320Test-1889715203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3617d007-879a-4a15-a498-ce9b31221776 tempest-GroupsV320Test-1889715203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3617d007-879a-4a15-a498-ce9b31221776 tempest-GroupsV320Test-1889715203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:39:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3617d007-879a-4a15-a498-ce9b31221776 tempest-GroupsV320Test-1889715203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:39:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3617d007-879a-4a15-a498-ce9b31221776 tempest-GroupsV320Test-1889715203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3617d007-879a-4a15-a498-ce9b31221776 tempest-GroupsV320Test-1889715203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:11 devstack sudo[95368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:39:11 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:11 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3617d007-879a-4a15-a498-ce9b31221776 tempest-GroupsV320Test-1889715203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:11 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-3617d007-879a-4a15-a498-ce9b31221776 tempest-GroupsV320Test-1889715203 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:39:11 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3617d007-879a-4a15-a498-ce9b31221776 tempest-GroupsV320Test-1889715203 None] Delete group completed successfully.
Nov 05 18:39:21 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:39:21 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Flow 'volume_create_manager' (9127cee5-a3e6-4730-a115-077882fe85de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b72b9fe-da45-4511-b192-a6b632d80855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b72b9fe-da45-4511-b192-a6b632d80855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-306496526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65405479-3ae2-42d1-bb51-4831614f84dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d14916e24a44851bd1a9d286fa881b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:39:23Z,use_quota=True,user_id='24caf190e11b4ca396dc62f2496dd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fcdcdb-5281-43f5-ae6e-34f50a8be84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fcdcdb-5281-43f5-ae6e-34f50a8be84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6ea799-b3d4-4557-accd-bedb0488936e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6ea799-b3d4-4557-accd-bedb0488936e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65405479-3ae2-42d1-bb51-4831614f84dc', 'volume_name': 'volume-65405479-3ae2-42d1-bb51-4831614f84dc', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e93d9cb-57a8-4b66-8319-a0537875554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e93d9cb-57a8-4b66-8319-a0537875554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fb2a7e-8967-462b-8c13-5a77cc33868e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Volume 65405479-3ae2-42d1-bb51-4831614f84dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65405479-3ae2-42d1-bb51-4831614f84dc', 'volume_size': 1}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-306496526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65405479-3ae2-42d1-bb51-4831614f84dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d14916e24a44851bd1a9d286fa881b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:39:23Z,use_quota=True,user_id='24caf190e11b4ca396dc62f2496dd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Creating volume 65405479-3ae2-42d1-bb51-4831614f84dc {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:39:23 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:23 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc 1073741824
Nov 05 18:39:23 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:23 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc 1073741824" returned: 0 in 0.456s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:23 devstack sudo[95423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc
Nov 05 18:39:23 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:24 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc" returned: 0 in 0.276s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:39:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1fb2a7e-8967-462b-8c13-5a77cc33868e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65405479-3ae2-42d1-bb51-4831614f84dc', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d343f571-a1ed-4654-bdc7-3494e69e5ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:24 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Volume volume-65405479-3ae2-42d1-bb51-4831614f84dc (65405479-3ae2-42d1-bb51-4831614f84dc): created successfully
Nov 05 18:39:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d343f571-a1ed-4654-bdc7-3494e69e5ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Flow 'volume_create_manager' (9127cee5-a3e6-4730-a115-077882fe85de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:39:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a8db2ffa-ff34-4458-8e7f-276214cddf5f tempest-AttachVolumeNegativeTest-1126432362 None] Created volume successfully.
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Flow 'volume_create_manager' (00afe7bb-b616-4e70-8f7e-d35eadc18a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb2aa6e-3460-4649-a2ab-942008db4aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb2aa6e-3460-4649-a2ab-942008db4aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1365451583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2efd32-368a-494f-a6a2-6a18dbf6141e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa73e5bf51e544578f23b032ca8fe45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:39:25Z,use_quota=True,user_id='eb559928f7094c828bf59b19664d22b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59acfeaa-8c5c-45d6-b998-e3bf63964ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59acfeaa-8c5c-45d6-b998-e3bf63964ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4852a804-9b48-4735-90c4-628b25d31592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4852a804-9b48-4735-90c4-628b25d31592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2efd32-368a-494f-a6a2-6a18dbf6141e', 'volume_name': 'volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1215ba-5ecb-4c93-8ed1-f816ee2ba1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1215ba-5ecb-4c93-8ed1-f816ee2ba1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f38618-566f-40bc-a9a1-8276fe752103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:25 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Volume ec2efd32-368a-494f-a6a2-6a18dbf6141e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e', 'volume_size': 1}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1365451583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2efd32-368a-494f-a6a2-6a18dbf6141e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa73e5bf51e544578f23b032ca8fe45d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:39:25Z,use_quota=True,user_id='eb559928f7094c828bf59b19664d22b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Creating volume ec2efd32-368a-494f-a6a2-6a18dbf6141e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:39:25 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:25 devstack sudo[95429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e 1073741824
Nov 05 18:39:25 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:25 devstack sudo[95438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:39:25 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:25 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e 1073741824" returned: 0 in 0.603s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:25 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.343s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:39:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:25 devstack sudo[95442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e
Nov 05 18:39:25 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:26 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e" returned: 0 in 0.295s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f38618-566f-40bc-a9a1-8276fe752103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f3b9ab-067c-4910-a413-30b7436bc3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:26 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Volume volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e (ec2efd32-368a-494f-a6a2-6a18dbf6141e): created successfully
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f3b9ab-067c-4910-a413-30b7436bc3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Flow 'volume_create_manager' (00afe7bb-b616-4e70-8f7e-d35eadc18a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:39:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-84589f40-146b-41be-a280-4ea5fa9eee28 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Created volume successfully.
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-323485a8-d2e2-4d5d-b673-6e46cf144da8 req-0d88ff1d-64ef-45fb-8c37-f3af0dde4ed9 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-323485a8-d2e2-4d5d-b673-6e46cf144da8 req-0d88ff1d-64ef-45fb-8c37-f3af0dde4ed9 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-323485a8-d2e2-4d5d-b673-6e46cf144da8 req-0d88ff1d-64ef-45fb-8c37-f3af0dde4ed9 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-323485a8-d2e2-4d5d-b673-6e46cf144da8 req-0d88ff1d-64ef-45fb-8c37-f3af0dde4ed9 tempest-AttachVolumeNegativeTest-1126432362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-65405479-3ae2-42d1-bb51-4831614f84dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58415390-f638-464e-a0bc-6204e620de2c', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:39:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-323485a8-d2e2-4d5d-b673-6e46cf144da8 req-0d88ff1d-64ef-45fb-8c37-f3af0dde4ed9 tempest-AttachVolumeNegativeTest-1126432362 None] attachment_update completed successfully.
Nov 05 18:39:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-dd6e54f6-b6c9-4878-a9f4-cb8cb518f412 req-ad24f540-b51f-4f13-b6b0-c71f10b639b7 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-dd6e54f6-b6c9-4878-a9f4-cb8cb518f412 req-ad24f540-b51f-4f13-b6b0-c71f10b639b7 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-dd6e54f6-b6c9-4878-a9f4-cb8cb518f412 req-ad24f540-b51f-4f13-b6b0-c71f10b639b7 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-dd6e54f6-b6c9-4878-a9f4-cb8cb518f412 req-ad24f540-b51f-4f13-b6b0-c71f10b639b7 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69505668-209e-44f8-8661-b27e020f3a71', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:39:28 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-dd6e54f6-b6c9-4878-a9f4-cb8cb518f412 req-ad24f540-b51f-4f13-b6b0-c71f10b639b7 tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] attachment_update completed successfully.
Nov 05 18:39:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-587a038c-f27f-4222-afc4-fb45ec2fc351 req-d5b0f08f-087d-4a74-a1fd-5534bc40ab2a tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Terminate volume connection completed successfully.
Nov 05 18:39:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-587a038c-f27f-4222-afc4-fb45ec2fc351 req-d5b0f08f-087d-4a74-a1fd-5534bc40ab2a tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Deleting attachment 69505668-209e-44f8-8661-b27e020f3a71. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Flow 'volume_create_manager' (9e88d9a1-a737-418c-a5e1-595199a5b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a2f470-223a-4db1-9f72-691b5b8a263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a2f470-223a-4db1-9f72-691b5b8a263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1668132158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b8e24c-94bb-478c-9535-041a08307c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c190efcc244072a3c3f506328fbdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:39:33Z,use_quota=True,user_id='555dcecb187e49a1a792419056865fa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0ae7e7-dfe4-4359-af69-5d1af32000b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0ae7e7-dfe4-4359-af69-5d1af32000b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b6880c-02a9-49fb-9d4e-9b4f03c9071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b6880c-02a9-49fb-9d4e-9b4f03c9071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b8e24c-94bb-478c-9535-041a08307c01', 'volume_name': 'volume-77b8e24c-94bb-478c-9535-041a08307c01', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc54d3f-ad0a-405e-b920-012c76e6188f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc54d3f-ad0a-405e-b920-012c76e6188f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b2b094-be8e-44e9-a69b-0984f475dc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:33 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Volume 77b8e24c-94bb-478c-9535-041a08307c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b8e24c-94bb-478c-9535-041a08307c01', 'volume_size': 1}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1668132158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b8e24c-94bb-478c-9535-041a08307c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55c190efcc244072a3c3f506328fbdc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:39:33Z,use_quota=True,user_id='555dcecb187e49a1a792419056865fa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Creating volume 77b8e24c-94bb-478c-9535-041a08307c01 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:39:33 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:33 devstack sudo[95894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01 1073741824
Nov 05 18:39:33 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Acquiring lock "cinder-ec2efd32-368a-494f-a6a2-6a18dbf6141e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "cinder-ec2efd32-368a-494f-a6a2-6a18dbf6141e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:39:33 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01 1073741824" returned: 0 in 0.598s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Acquiring lock "cinder-quobyte-ec2efd32-368a-494f-a6a2-6a18dbf6141e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "cinder-quobyte-ec2efd32-368a-494f-a6a2-6a18dbf6141e" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f0a67b-df53-43c3-aa42-c0075903e63e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:33 devstack sudo[95902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01
Nov 05 18:39:33 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:34 devstack sudo[95901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e
Nov 05 18:39:34 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:34 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01" returned: 0 in 0.329s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b2b094-be8e-44e9-a69b-0984f475dc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b8e24c-94bb-478c-9535-041a08307c01', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a67b48b-7cc2-4e23-9743-dc90b022f345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:34 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Volume volume-77b8e24c-94bb-478c-9535-041a08307c01 (77b8e24c-94bb-478c-9535-041a08307c01): created successfully
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a67b48b-7cc2-4e23-9743-dc90b022f345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Flow 'volume_create_manager' (9e88d9a1-a737-418c-a5e1-595199a5b904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:39:34 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-01912182-e339-44df-b001-3c9f92366ae2 tempest-AttachVolumeShelveTestJSON-1204803832 None] Created volume successfully.
Nov 05 18:39:34 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e" returned: 0 in 0.502s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:34 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e
Nov 05 18:39:34 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:34 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ec2efd32-368a-494f-a6a2-6a18dbf6141e" returned: 0 in 0.348s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "cinder-quobyte-ec2efd32-368a-494f-a6a2-6a18dbf6141e" released by "delete_volume" :: held 0.912s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:39:34 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Created reservations ['619a75bf-a1a2-47e7-8254-cf3912037c04', '5b74a348-6695-44a7-9e16-04be17aec237', 'fc13b319-5c67-466f-b6d7-e198c336933e', '17c27285-e0eb-4c5a-9660-a5188cb58e98'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:39:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:39:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:39:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:35 devstack sudo[95921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:39:35 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:35 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.347s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:35 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:39:35 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Deleted volume successfully.
Nov 05 18:39:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9e761efe-c041-4df1-ac30-9bf34f1a215c tempest-TestServerVolumeAttachScenarioOldVersion-771100004 None] Lock "cinder-ec2efd32-368a-494f-a6a2-6a18dbf6141e-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Flow 'volume_create_manager' (2f1c7647-7021-4b40-b07c-28ef8cdf3317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9395d1c-fd7c-420e-9a31-4cce126dd80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9395d1c-fd7c-420e-9a31-4cce126dd80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2052214763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5abf3dd-13a6-440c-8d3a-40beeb4bb839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15745683cfa4107a6282d11399d2aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:39:51Z,use_quota=True,user_id='cde3eea17f294a1a8fe21ca4b926bf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fee936-ad43-472a-bc53-ae3ce3d06c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fee936-ad43-472a-bc53-ae3ce3d06c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b69092-c4f5-47e0-997b-caac1e2e4170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b69092-c4f5-47e0-997b-caac1e2e4170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5abf3dd-13a6-440c-8d3a-40beeb4bb839', 'volume_name': 'volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f981dd6-9777-4c16-bbc2-9d8b647df0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f981dd6-9777-4c16-bbc2-9d8b647df0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cb6802-a91c-4ad5-8d17-5ae340578b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:51 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Volume f5abf3dd-13a6-440c-8d3a-40beeb4bb839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839', 'volume_size': 1}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2052214763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5abf3dd-13a6-440c-8d3a-40beeb4bb839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15745683cfa4107a6282d11399d2aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:39:51Z,use_quota=True,user_id='cde3eea17f294a1a8fe21ca4b926bf17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Creating volume f5abf3dd-13a6-440c-8d3a-40beeb4bb839 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:39:51 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:39:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:51 devstack sudo[96137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839 1073741824
Nov 05 18:39:51 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:52 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839 1073741824" returned: 0 in 0.658s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:52 devstack sudo[96143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839
Nov 05 18:39:52 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:52 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839" returned: 0 in 0.343s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:39:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cb6802-a91c-4ad5-8d17-5ae340578b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9082487e-852d-49fd-87f3-f990f2605756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:39:52 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Volume volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839 (f5abf3dd-13a6-440c-8d3a-40beeb4bb839): created successfully
Nov 05 18:39:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9082487e-852d-49fd-87f3-f990f2605756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:39:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Flow 'volume_create_manager' (2f1c7647-7021-4b40-b07c-28ef8cdf3317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:39:52 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-236c2358-cb84-4f66-bb50-f44a0e1b0b69 tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Created volume successfully.
Nov 05 18:39:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-6e48b43d-b97c-4092-a535-f9f01d835805 req-a5818d87-7a85-4074-b113-f3f4922e6573 tempest-AttachVolumeShelveTestJSON-1204803832 None] No connector for attachment 9f40f074-2aff-44db-b7b9-ec91b15c0ff4; skipping storage backend terminate_connection call. {{(pid=87086) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}}
Nov 05 18:39:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-6e48b43d-b97c-4092-a535-f9f01d835805 req-a5818d87-7a85-4074-b113-f3f4922e6573 tempest-AttachVolumeShelveTestJSON-1204803832 None] Deleting attachment 9f40f074-2aff-44db-b7b9-ec91b15c0ff4. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:39:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Acquiring lock "cinder-f5abf3dd-13a6-440c-8d3a-40beeb4bb839-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:39:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Lock "cinder-f5abf3dd-13a6-440c-8d3a-40beeb4bb839-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:39:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Acquiring lock "cinder-quobyte-f5abf3dd-13a6-440c-8d3a-40beeb4bb839" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:39:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Lock "cinder-quobyte-f5abf3dd-13a6-440c-8d3a-40beeb4bb839" acquired by "delete_volume" :: waited 0.013s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:39:55 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[56016cd2-7e41-46b0-a549-71da62343a61]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:39:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:55 devstack sudo[96174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839
Nov 05 18:39:55 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:55 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839" returned: 0 in 0.592s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:55 devstack sudo[96179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839
Nov 05 18:39:55 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:56 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f5abf3dd-13a6-440c-8d3a-40beeb4bb839" returned: 0 in 0.297s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Lock "cinder-quobyte-f5abf3dd-13a6-440c-8d3a-40beeb4bb839" released by "delete_volume" :: held 0.940s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Created reservations ['bfb1c693-2121-4afa-949e-99accf563333', '8047fd5e-1bb5-4bc8-8a3c-859b070cf417', '036f3d2a-ec09-46f4-b754-04fa684a2411', '4538501b-ac72-4619-96cf-62b2d6dd720b'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:39:56 devstack sudo[96182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:39:56 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:39:56 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.282s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:39:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Deleted volume successfully.
Nov 05 18:39:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-22e15264-f9a9-4070-b8ed-6cbefde1d01e tempest-VolumeQuotasNegativeTestJSON-1735272315 None] Lock "cinder-f5abf3dd-13a6-440c-8d3a-40beeb4bb839-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=36,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=38,cinder:SELECT=31,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Flow 'volume_create_manager' (aaf80527-deed-4d7c-9985-169d3344446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717eca35-d47b-4a95-9010-36d8677e8dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717eca35-d47b-4a95-9010-36d8677e8dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-414667079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808f6fab-3ed7-4e24-aabc-e47d2565d4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6501489276ca48b39f98a3dc0de658d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:07Z,use_quota=True,user_id='989ce32a0dfc4132833983480cb1059c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb09d951-4e21-454d-86d0-4ea0385d02b1),volume_type_id=cb09d951-4e21-454d-86d0-4ea0385d02b1)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd1216e-130a-4345-bd9b-80116a18bf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd1216e-130a-4345-bd9b-80116a18bf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18da87db-7bcd-4812-9823-473af9cb4fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18da87db-7bcd-4812-9823-473af9cb4fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808f6fab-3ed7-4e24-aabc-e47d2565d4ed', 'volume_name': 'volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced6e928-61f7-4cbb-9c90-e6b90000c6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced6e928-61f7-4cbb-9c90-e6b90000c6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1cd3af-d408-400b-9b21-dd5bc3c7ee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:06 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Volume 808f6fab-3ed7-4e24-aabc-e47d2565d4ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed', 'volume_size': 1}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-414667079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808f6fab-3ed7-4e24-aabc-e47d2565d4ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6501489276ca48b39f98a3dc0de658d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:07Z,use_quota=True,user_id='989ce32a0dfc4132833983480cb1059c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb09d951-4e21-454d-86d0-4ea0385d02b1),volume_type_id=cb09d951-4e21-454d-86d0-4ea0385d02b1)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Creating volume 808f6fab-3ed7-4e24-aabc-e47d2565d4ed {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:40:06 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:40:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:06 devstack sudo[96296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed 1073741824
Nov 05 18:40:06 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:07 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed 1073741824" returned: 0 in 0.723s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:07 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed
Nov 05 18:40:07 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:08 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed" returned: 0 in 0.396s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:40:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1cd3af-d408-400b-9b21-dd5bc3c7ee76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99009f8c-7b9e-4224-8a31-37e951089def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:08 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Volume volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed (808f6fab-3ed7-4e24-aabc-e47d2565d4ed): created successfully
Nov 05 18:40:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99009f8c-7b9e-4224-8a31-37e951089def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Flow 'volume_create_manager' (aaf80527-deed-4d7c-9985-169d3344446a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:08 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e5face78-4765-498c-a021-cba100b2a1a0 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Created volume successfully.
Nov 05 18:40:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-27c12521-d04d-4fdf-95b1-5c604523aab7 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-27c12521-d04d-4fdf-95b1-5c604523aab7 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-27c12521-d04d-4fdf-95b1-5c604523aab7 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-27c12521-d04d-4fdf-95b1-5c604523aab7 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-27c12521-d04d-4fdf-95b1-5c604523aab7 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-27c12521-d04d-4fdf-95b1-5c604523aab7 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:10 devstack sudo[96330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:40:10 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:10 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-27c12521-d04d-4fdf-95b1-5c604523aab7 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.360s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:10 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-27c12521-d04d-4fdf-95b1-5c604523aab7 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:40:10 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-27c12521-d04d-4fdf-95b1-5c604523aab7 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Retype volume completed successfully.
Nov 05 18:40:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Acquiring lock "cinder-808f6fab-3ed7-4e24-aabc-e47d2565d4ed-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:40:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "cinder-808f6fab-3ed7-4e24-aabc-e47d2565d4ed-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:40:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Acquiring lock "cinder-quobyte-808f6fab-3ed7-4e24-aabc-e47d2565d4ed" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:40:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "cinder-quobyte-808f6fab-3ed7-4e24-aabc-e47d2565d4ed" acquired by "delete_volume" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:40:11 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd32f75-d496-4c75-aa8f-f52f6ea57d98]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:40:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:12 devstack sudo[96334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed
Nov 05 18:40:12 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:12 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed" returned: 0 in 0.962s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:13 devstack sudo[96341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed
Nov 05 18:40:13 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:13 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-808f6fab-3ed7-4e24-aabc-e47d2565d4ed" returned: 0 in 0.595s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "cinder-quobyte-808f6fab-3ed7-4e24-aabc-e47d2565d4ed" released by "delete_volume" :: held 1.662s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:40:13 devstack cinder-volume[87086]: WARNING cinder.quota [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:40:13 devstack cinder-volume[87086]: WARNING cinder.quota [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:40:13 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Created reservations ['94182ff1-7f80-49ee-a8e8-164832bc15d6', '39990c20-f76f-4b21-9181-311d84e7fb08', '8fdd59ce-a56b-4bb3-a8e4-8ce5fb90a25e', 'e62cff09-76e4-4f26-a01f-7c1a2812eb0e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:40:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:13 devstack sudo[96345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:40:13 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:14 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.409s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:14 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:40:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Deleted volume successfully.
Nov 05 18:40:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f4fc8eac-452a-46e9-aa7d-7c3512fd7da3 tempest-VolumeRetypeWithoutMigrationTest-1845690562 None] Lock "cinder-808f6fab-3ed7-4e24-aabc-e47d2565d4ed-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:40:20 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-aaf34c67-b28a-418b-a5ef-5761131d02e6 req-f9b0e090-c2ed-4ddb-abad-8dc98db143a5 tempest-AttachVolumeNegativeTest-1126432362 None] Terminate volume connection completed successfully.
Nov 05 18:40:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-aaf34c67-b28a-418b-a5ef-5761131d02e6 req-f9b0e090-c2ed-4ddb-abad-8dc98db143a5 tempest-AttachVolumeNegativeTest-1126432362 None] Deleting attachment 58415390-f638-464e-a0bc-6204e620de2c. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:40:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:40:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:25 devstack sudo[96393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:40:25 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:25 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.411s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:40:26 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:40:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:40:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:40:28 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Flow 'volume_create_manager' (76368738-95ab-4909-a125-4e285e9f4c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a786249-0be5-4c14-b37e-9acce6774bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a786249-0be5-4c14-b37e-9acce6774bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1326932972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81a620d-ac16-4f47-90f3-a998cd09193c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e594b1db0b344ee5b6746b99e82b5ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:29Z,use_quota=True,user_id='3d03cb0171ae4b28836fd0b99c006020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0279af67-8089-468b-9e2e-b63b920e5eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0279af67-8089-468b-9e2e-b63b920e5eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92404b7f-30d8-4e10-94cb-a6daa96ca284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92404b7f-30d8-4e10-94cb-a6daa96ca284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81a620d-ac16-4f47-90f3-a998cd09193c', 'volume_name': 'volume-f81a620d-ac16-4f47-90f3-a998cd09193c', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f686cf5-eef5-434c-b3f9-7b4a293b506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f686cf5-eef5-434c-b3f9-7b4a293b506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d40b3d-f798-4e8d-9e53-b1849fbf8449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:29 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Volume f81a620d-ac16-4f47-90f3-a998cd09193c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81a620d-ac16-4f47-90f3-a998cd09193c', 'volume_size': 1}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1326932972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81a620d-ac16-4f47-90f3-a998cd09193c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e594b1db0b344ee5b6746b99e82b5ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:29Z,use_quota=True,user_id='3d03cb0171ae4b28836fd0b99c006020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Creating volume f81a620d-ac16-4f47-90f3-a998cd09193c {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:40:29 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:29 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c 1073741824
Nov 05 18:40:29 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Flow 'volume_create_manager' (9ec04a9e-6653-4be6-82c9-cafa75d3b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2404551-dc54-4e9a-ade0-b35d7697986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2404551-dc54-4e9a-ade0-b35d7697986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1243172738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727a4afd-33dd-4759-89b9-3952308076da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e594b1db0b344ee5b6746b99e82b5ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:30Z,use_quota=True,user_id='3d03cb0171ae4b28836fd0b99c006020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530129d7-5f6f-4c1d-8377-1502462352aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530129d7-5f6f-4c1d-8377-1502462352aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b226ae-7476-4ac9-8158-992fd73075b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b226ae-7476-4ac9-8158-992fd73075b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727a4afd-33dd-4759-89b9-3952308076da', 'volume_name': 'volume-727a4afd-33dd-4759-89b9-3952308076da', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb34a9c-bc12-4bef-b805-aa895bfb73ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb34a9c-bc12-4bef-b805-aa895bfb73ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517ca49b-a617-435b-ac47-396a4ff3f3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:29 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Volume 727a4afd-33dd-4759-89b9-3952308076da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727a4afd-33dd-4759-89b9-3952308076da', 'volume_size': 1}
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:29 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c 1073741824" returned: 0 in 0.818s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:30 devstack sudo[96424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c
Nov 05 18:40:30 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:30 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c" returned: 0 in 0.277s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.355s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1243172738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727a4afd-33dd-4759-89b9-3952308076da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e594b1db0b344ee5b6746b99e82b5ffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:30Z,use_quota=True,user_id='3d03cb0171ae4b28836fd0b99c006020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Creating volume 727a4afd-33dd-4759-89b9-3952308076da {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:40:30 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d40b3d-f798-4e8d-9e53-b1849fbf8449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81a620d-ac16-4f47-90f3-a998cd09193c', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05d1fed-d0f3-41a7-afe9-0640109e1dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:30 devstack sudo[96427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da 1073741824
Nov 05 18:40:30 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:30 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Volume volume-f81a620d-ac16-4f47-90f3-a998cd09193c (f81a620d-ac16-4f47-90f3-a998cd09193c): created successfully
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05d1fed-d0f3-41a7-afe9-0640109e1dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Flow 'volume_create_manager' (76368738-95ab-4909-a125-4e285e9f4c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:30 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9ccee842-9605-4131-855f-f0fd82e797ae tempest-TestServerVolumeAttachmentScenario-258812409 None] Created volume successfully.
Nov 05 18:40:30 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da 1073741824" returned: 0 in 0.619s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:30 devstack sudo[96433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da
Nov 05 18:40:30 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:31 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da" returned: 0 in 0.262s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:40:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517ca49b-a617-435b-ac47-396a4ff3f3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727a4afd-33dd-4759-89b9-3952308076da', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b3d70b-da18-4b6e-9e5c-13fd490a432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:31 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Volume volume-727a4afd-33dd-4759-89b9-3952308076da (727a4afd-33dd-4759-89b9-3952308076da): created successfully
Nov 05 18:40:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b3d70b-da18-4b6e-9e5c-13fd490a432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Flow 'volume_create_manager' (9ec04a9e-6653-4be6-82c9-cafa75d3b801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:31 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ab19ae97-3a19-4d75-80a9-499eada7981f tempest-TestServerVolumeAttachmentScenario-258812409 None] Created volume successfully.
Nov 05 18:40:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Acquiring lock "cinder-77b8e24c-94bb-478c-9535-041a08307c01-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:40:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Lock "cinder-77b8e24c-94bb-478c-9535-041a08307c01-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:40:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Acquiring lock "cinder-quobyte-77b8e24c-94bb-478c-9535-041a08307c01" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:40:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Lock "cinder-quobyte-77b8e24c-94bb-478c-9535-041a08307c01" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:40:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dfd5e0-e43a-4771-8789-a9c185691507]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:40:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:36 devstack sudo[96445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01
Nov 05 18:40:36 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:36 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01" returned: 0 in 0.462s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:36 devstack sudo[96454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01
Nov 05 18:40:36 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:36 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77b8e24c-94bb-478c-9535-041a08307c01" returned: 0 in 0.558s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Lock "cinder-quobyte-77b8e24c-94bb-478c-9535-041a08307c01" released by "delete_volume" :: held 1.098s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:40:37 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Created reservations ['4095607d-b873-4bf8-9081-c816789f3664', 'f14221d2-ba59-4b5d-ae37-49b5a5a2f2ea', '8f5e2b25-90af-403c-afff-9cb11ce134a1', 'aae576dd-e47b-4c8c-be01-a5f4222dd85c'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:40:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:37 devstack sudo[96474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:40:37 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:37 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.319s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:37 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:40:37 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Deleted volume successfully.
Nov 05 18:40:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-841bff64-6afb-4bbb-9bc9-4479ee890167 tempest-AttachVolumeShelveTestJSON-1204803832 None] Lock "cinder-77b8e24c-94bb-478c-9535-041a08307c01-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:40:47 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=25,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:40:47 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Flow 'volume_create_manager' (e7a84176-d184-4eb2-a415-cd7dd10eea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f269b19-f2ba-4e04-8419-54524d9c8179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f269b19-f2ba-4e04-8419-54524d9c8179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2023557768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be6e91e-afbd-42cb-9be0-9e88b93b09ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bdf4e4b1ca445c8b34700c08b6772e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:53Z,use_quota=True,user_id='d078e35d6c004595b0754d51edfd3e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b3ddc0-88a9-412e-9ed8-ebca1502a0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b3ddc0-88a9-412e-9ed8-ebca1502a0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93439ced-fc99-4a0b-98be-2623c60a6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93439ced-fc99-4a0b-98be-2623c60a6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be6e91e-afbd-42cb-9be0-9e88b93b09ed', 'volume_name': 'volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78770040-f2e1-48f1-9717-cb473997796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78770040-f2e1-48f1-9717-cb473997796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb15e38-764e-418e-b990-75986995fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:53 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Volume 9be6e91e-afbd-42cb-9be0-9e88b93b09ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed', 'volume_size': 1}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2023557768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be6e91e-afbd-42cb-9be0-9e88b93b09ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bdf4e4b1ca445c8b34700c08b6772e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:53Z,use_quota=True,user_id='d078e35d6c004595b0754d51edfd3e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Creating volume 9be6e91e-afbd-42cb-9be0-9e88b93b09ed {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:40:53 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:40:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:53 devstack sudo[96696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed 1073741824
Nov 05 18:40:53 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:54 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed 1073741824" returned: 0 in 0.918s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:54 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed
Nov 05 18:40:54 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:54 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed" returned: 0 in 0.447s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:40:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb15e38-764e-418e-b990-75986995fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d47998-fcc0-4d4b-95ff-72d619202e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:54 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Volume volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed (9be6e91e-afbd-42cb-9be0-9e88b93b09ed): created successfully
Nov 05 18:40:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d47998-fcc0-4d4b-95ff-72d619202e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Flow 'volume_create_manager' (e7a84176-d184-4eb2-a415-cd7dd10eea3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:54 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6c67894c-8c17-4404-81da-09a98225c1f5 tempest-VolumesListAdminTestJSON-178103661 None] Created volume successfully.
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Flow 'volume_create_manager' (52d75de3-b3e2-4a0e-b178-81ce55a9014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ccbf53-0670-4fbf-a9cf-234583fac9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ccbf53-0670-4fbf-a9cf-234583fac9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1889408824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8168a7a-60f3-4a3a-bce4-13cb2cbe5189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bdf4e4b1ca445c8b34700c08b6772e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:56Z,use_quota=True,user_id='d078e35d6c004595b0754d51edfd3e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b389b5c-890f-4cfd-806b-35ed718f97e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b389b5c-890f-4cfd-806b-35ed718f97e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976fbd07-10dc-4fea-89a5-8027f8df95ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976fbd07-10dc-4fea-89a5-8027f8df95ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8168a7a-60f3-4a3a-bce4-13cb2cbe5189', 'volume_name': 'volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cb2fd5-b3f4-4111-b097-e499be7ad6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cb2fd5-b3f4-4111-b097-e499be7ad6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cff5650-48b9-4858-850e-2778bb993d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:55 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Volume e8168a7a-60f3-4a3a-bce4-13cb2cbe5189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189', 'volume_size': 1}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1889408824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8168a7a-60f3-4a3a-bce4-13cb2cbe5189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bdf4e4b1ca445c8b34700c08b6772e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:56Z,use_quota=True,user_id='d078e35d6c004595b0754d51edfd3e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Creating volume e8168a7a-60f3-4a3a-bce4-13cb2cbe5189 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:40:55 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:40:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:55 devstack sudo[96708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189 1073741824
Nov 05 18:40:55 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Flow 'volume_create_manager' (697e689d-be2f-4432-bbdc-e6e8aa0e54f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad35ae2-c978-42bc-8a26-4d31c81bca49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad35ae2-c978-42bc-8a26-4d31c81bca49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2015788198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3e6681-952d-47e9-b568-0f7d6560a3d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1e742ceea499380e94406e550c914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:56Z,use_quota=True,user_id='c4f044d03fe94f848fb3ece2d97bf284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dac3889-c92c-4ec4-b63e-648c0950a87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dac3889-c92c-4ec4-b63e-648c0950a87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c8dae9-60ac-4b35-bb34-5dddcf8e3fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c8dae9-60ac-4b35-bb34-5dddcf8e3fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3e6681-952d-47e9-b568-0f7d6560a3d6', 'volume_name': 'volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a036f3cc-1755-4ef5-add3-0f0b1236670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a036f3cc-1755-4ef5-add3-0f0b1236670d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:56 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a55431f-6516-4371-9062-ef0c3a10660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:56 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Volume 0a3e6681-952d-47e9-b568-0f7d6560a3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6', 'volume_size': 1}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189 1073741824" returned: 0 in 0.595s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:56 devstack sudo[96714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189
Nov 05 18:40:56 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:56 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189" returned: 0 in 0.284s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2015788198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3e6681-952d-47e9-b568-0f7d6560a3d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1e742ceea499380e94406e550c914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:56Z,use_quota=True,user_id='c4f044d03fe94f848fb3ece2d97bf284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Creating volume 0a3e6681-952d-47e9-b568-0f7d6560a3d6 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:40:56 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cff5650-48b9-4858-850e-2778bb993d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:56 devstack sudo[96717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6 1073741824
Nov 05 18:40:56 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3d99a8-734c-461a-afdf-604bb947cb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:56 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Volume volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189 (e8168a7a-60f3-4a3a-bce4-13cb2cbe5189): created successfully
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3d99a8-734c-461a-afdf-604bb947cb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Flow 'volume_create_manager' (52d75de3-b3e2-4a0e-b178-81ce55a9014a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a1a6fb1e-fae3-4c4d-9337-978543c830a3 tempest-VolumesListAdminTestJSON-178103661 None] Created volume successfully.
Nov 05 18:40:57 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6 1073741824" returned: 0 in 0.439s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:57 devstack sudo[96722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6
Nov 05 18:40:57 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:57 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6" returned: 0 in 0.253s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:40:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a55431f-6516-4371-9062-ef0c3a10660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f878fa-fd9e-4682-9915-f6932385a8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:57 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Volume volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6 (0a3e6681-952d-47e9-b568-0f7d6560a3d6): created successfully
Nov 05 18:40:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f878fa-fd9e-4682-9915-f6932385a8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Flow 'volume_create_manager' (697e689d-be2f-4432-bbdc-e6e8aa0e54f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:57 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-afc8968b-8e03-410a-bc9c-4ec97f5694b7 tempest-VolumesTestJSON-240740549 None] Created volume successfully.
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Flow 'volume_create_manager' (905c828b-fcff-4e58-aa0a-44f116867f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70653aa-8018-4b6c-b50b-c8bfa39739a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c70653aa-8018-4b6c-b50b-c8bfa39739a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1738979962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8322e966-3de0-40cd-a295-a1796d861d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bdf4e4b1ca445c8b34700c08b6772e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:58Z,use_quota=True,user_id='d078e35d6c004595b0754d51edfd3e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7944eb-3ecd-44ad-b0b8-ed4bf55fd2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7944eb-3ecd-44ad-b0b8-ed4bf55fd2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bfa2ab-90e1-402c-8007-023767642084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bfa2ab-90e1-402c-8007-023767642084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8322e966-3de0-40cd-a295-a1796d861d98', 'volume_name': 'volume-8322e966-3de0-40cd-a295-a1796d861d98', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc02b012-84f5-4af6-bd31-2d126b48956b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc02b012-84f5-4af6-bd31-2d126b48956b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dffc59f-1bb6-4885-a135-349bd7a92428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:58 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Volume 8322e966-3de0-40cd-a295-a1796d861d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8322e966-3de0-40cd-a295-a1796d861d98', 'volume_size': 1}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1738979962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8322e966-3de0-40cd-a295-a1796d861d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bdf4e4b1ca445c8b34700c08b6772e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:58Z,use_quota=True,user_id='d078e35d6c004595b0754d51edfd3e59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Creating volume 8322e966-3de0-40cd-a295-a1796d861d98 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:40:58 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:40:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:58 devstack sudo[96726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98 1073741824
Nov 05 18:40:58 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:59 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98 1073741824" returned: 0 in 0.645s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:59 devstack sudo[96766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98
Nov 05 18:40:59 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Flow 'volume_create_manager' (cd0ec227-c508-48ba-9dc3-c5fe2421d714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e63d15d-90ab-4126-b690-8992258beebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e63d15d-90ab-4126-b690-8992258beebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-118776633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77f73bc-46fe-4a23-885b-8351cf3531a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1e742ceea499380e94406e550c914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:59Z,use_quota=True,user_id='c4f044d03fe94f848fb3ece2d97bf284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb72370-a144-417a-b3a5-e9da8274868e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb72370-a144-417a-b3a5-e9da8274868e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5b9757-0ea6-4525-8137-2f7dd6b96a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5b9757-0ea6-4525-8137-2f7dd6b96a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77f73bc-46fe-4a23-885b-8351cf3531a2', 'volume_name': 'volume-e77f73bc-46fe-4a23-885b-8351cf3531a2', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99345090-6078-4293-9356-fdd8c9624f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99345090-6078-4293-9356-fdd8c9624f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ad3fe0-d19e-4333-a68a-b3704a0cb0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:59 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Volume e77f73bc-46fe-4a23-885b-8351cf3531a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77f73bc-46fe-4a23-885b-8351cf3531a2', 'volume_size': 1}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:59 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98" returned: 0 in 0.368s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-118776633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77f73bc-46fe-4a23-885b-8351cf3531a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1e742ceea499380e94406e550c914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:40:59Z,use_quota=True,user_id='c4f044d03fe94f848fb3ece2d97bf284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Creating volume e77f73bc-46fe-4a23-885b-8351cf3531a2 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:40:59 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dffc59f-1bb6-4885-a135-349bd7a92428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8322e966-3de0-40cd-a295-a1796d861d98', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98aa51c6-23d2-4a7b-968c-c3bcaad6e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:40:59 devstack sudo[96769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2 1073741824
Nov 05 18:40:59 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:40:59 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Volume volume-8322e966-3de0-40cd-a295-a1796d861d98 (8322e966-3de0-40cd-a295-a1796d861d98): created successfully
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98aa51c6-23d2-4a7b-968c-c3bcaad6e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:40:59 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Flow 'volume_create_manager' (905c828b-fcff-4e58-aa0a-44f116867f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:40:59 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-cc891450-41e5-4e22-987a-56fe70f34b4e tempest-VolumesListAdminTestJSON-178103661 None] Created volume successfully.
Nov 05 18:41:00 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2 1073741824" returned: 0 in 0.462s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:00 devstack sudo[96774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2
Nov 05 18:41:00 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:00 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2" returned: 0 in 0.252s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:00 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ad3fe0-d19e-4333-a68a-b3704a0cb0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77f73bc-46fe-4a23-885b-8351cf3531a2', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:00 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8ea8ae-0d9a-4a22-a35e-8eefec113f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:00 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Volume volume-e77f73bc-46fe-4a23-885b-8351cf3531a2 (e77f73bc-46fe-4a23-885b-8351cf3531a2): created successfully
Nov 05 18:41:00 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8ea8ae-0d9a-4a22-a35e-8eefec113f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:00 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Flow 'volume_create_manager' (cd0ec227-c508-48ba-9dc3-c5fe2421d714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:00 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0e527fbc-8d06-42d3-93b6-370ea3be85a5 tempest-VolumesTestJSON-240740549 None] Created volume successfully.
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Flow 'volume_create_manager' (6eed5e0c-02dc-469b-a334-afe46466d9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee13a4b5-05d7-4f00-9f6e-94781495ef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee13a4b5-05d7-4f00-9f6e-94781495ef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7fe1edb-a58f-4405-9509-a2e7333e7e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c27e573c0447e884cc5db28f74ac2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:01Z,use_quota=True,user_id='0f0ed222401248f6b808e90e3ae8b0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96cdfe59-ea5f-45ef-9f3e-72e8539883a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96cdfe59-ea5f-45ef-9f3e-72e8539883a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e7013e-7c1f-4141-9d75-f52783ee5d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e7013e-7c1f-4141-9d75-f52783ee5d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7fe1edb-a58f-4405-9509-a2e7333e7e26', 'volume_name': 'volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eee23d1-b625-4704-a1cf-bb37b58209e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eee23d1-b625-4704-a1cf-bb37b58209e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce106bf9-1a2c-4298-94bf-95faa627ee0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:01 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Volume d7fe1edb-a58f-4405-9509-a2e7333e7e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26', 'volume_size': 1}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7fe1edb-a58f-4405-9509-a2e7333e7e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73c27e573c0447e884cc5db28f74ac2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:01Z,use_quota=True,user_id='0f0ed222401248f6b808e90e3ae8b0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Creating volume d7fe1edb-a58f-4405-9509-a2e7333e7e26 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:01 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:01 devstack sudo[96777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26 1073741824
Nov 05 18:41:01 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:01 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26 1073741824" returned: 0 in 0.543s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Flow 'volume_create_manager' (74de3541-fe49-4023-9bc4-b766d0ada2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f389b703-0349-4ff2-b52a-f3396898ea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f389b703-0349-4ff2-b52a-f3396898ea4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-931312829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad56170-0362-4366-94fa-dbd6676063db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1e742ceea499380e94406e550c914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:02Z,use_quota=True,user_id='c4f044d03fe94f848fb3ece2d97bf284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:02 devstack sudo[96782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26
Nov 05 18:41:02 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98acf050-35c3-4dba-997a-734b0fa44bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98acf050-35c3-4dba-997a-734b0fa44bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3f939e-0840-4ea0-b5df-1ab8a6778d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3f939e-0840-4ea0-b5df-1ab8a6778d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad56170-0362-4366-94fa-dbd6676063db', 'volume_name': 'volume-4ad56170-0362-4366-94fa-dbd6676063db', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521a433f-1d34-4489-880f-a876cefa9eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521a433f-1d34-4489-880f-a876cefa9eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec79d784-e1c8-46f0-9385-ba4b3b37855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Volume 4ad56170-0362-4366-94fa-dbd6676063db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad56170-0362-4366-94fa-dbd6676063db', 'volume_size': 1}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:02 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26" returned: 0 in 0.276s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.224s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-931312829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad56170-0362-4366-94fa-dbd6676063db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27f1e742ceea499380e94406e550c914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:02Z,use_quota=True,user_id='c4f044d03fe94f848fb3ece2d97bf284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Creating volume 4ad56170-0362-4366-94fa-dbd6676063db {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:02 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce106bf9-1a2c-4298-94bf-95faa627ee0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f449977-d66e-4e67-9087-3e3b1ab6d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:02 devstack sudo[96785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db 1073741824
Nov 05 18:41:02 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Volume volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26 (d7fe1edb-a58f-4405-9509-a2e7333e7e26): created successfully
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f449977-d66e-4e67-9087-3e3b1ab6d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Flow 'volume_create_manager' (6eed5e0c-02dc-469b-a334-afe46466d9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:02 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1572f76d-b4fc-453a-b63c-880d05ff6c65 tempest-VolumesListAdminTestJSON-2043581445 None] Created volume successfully.
Nov 05 18:41:02 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db 1073741824" returned: 0 in 0.441s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:02 devstack sudo[96811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db
Nov 05 18:41:02 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:03 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db" returned: 0 in 0.258s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec79d784-e1c8-46f0-9385-ba4b3b37855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad56170-0362-4366-94fa-dbd6676063db', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82b71de-56f9-4aad-92e1-94c84916c6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:03 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Volume volume-4ad56170-0362-4366-94fa-dbd6676063db (4ad56170-0362-4366-94fa-dbd6676063db): created successfully
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82b71de-56f9-4aad-92e1-94c84916c6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Flow 'volume_create_manager' (74de3541-fe49-4023-9bc4-b766d0ada2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:03 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2d9926e5-4434-4927-b94d-e8a27ffae2a2 tempest-VolumesTestJSON-240740549 None] Created volume successfully.
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Acquiring lock "cinder-d7fe1edb-a58f-4405-9509-a2e7333e7e26-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Lock "cinder-d7fe1edb-a58f-4405-9509-a2e7333e7e26-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Acquiring lock "cinder-quobyte-d7fe1edb-a58f-4405-9509-a2e7333e7e26" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Lock "cinder-quobyte-d7fe1edb-a58f-4405-9509-a2e7333e7e26" acquired by "delete_volume" :: waited 0.013s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1511ced-3258-43ae-bc1c-52928d5b033b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "cinder-8322e966-3de0-40cd-a295-a1796d861d98-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-8322e966-3de0-40cd-a295-a1796d861d98-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:03 devstack sudo[96814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26
Nov 05 18:41:03 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "cinder-quobyte-8322e966-3de0-40cd-a295-a1796d861d98" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-quobyte-8322e966-3de0-40cd-a295-a1796d861d98" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4d2d41-b1de-4bca-9dc6-3de5a1beedd9]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:03 devstack sudo[96816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98
Nov 05 18:41:03 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:03 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26" returned: 0 in 0.398s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:03 devstack sudo[96821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26
Nov 05 18:41:03 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:04 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98" returned: 0 in 0.423s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:04 devstack sudo[96828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98
Nov 05 18:41:04 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:04 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d7fe1edb-a58f-4405-9509-a2e7333e7e26" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Lock "cinder-quobyte-d7fe1edb-a58f-4405-9509-a2e7333e7e26" released by "delete_volume" :: held 0.747s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Created reservations ['8a8d98b4-c875-4862-9575-894ec8fc2743', '9e901333-5287-47f7-9a13-3a920677ae13', '6cc21ba7-57a5-4557-a012-92ecafb301a4', 'f859ad2c-d079-4a40-b128-75e8493180db'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:04 devstack sudo[96830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:04 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:04 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8322e966-3de0-40cd-a295-a1796d861d98" returned: 0 in 0.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-quobyte-8322e966-3de0-40cd-a295-a1796d861d98" released by "delete_volume" :: held 0.772s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Created reservations ['b3edb60b-d239-4a3c-bfc1-6e6452a4bfed', '9d1e61c3-08e0-44bd-b8ca-ac2202c27be3', '9df764cc-2c13-41f7-8f25-84e28b0ad953', 'f9152f13-e038-485b-abae-2fb1540c609a'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:04 devstack sudo[96834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:04 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:04 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Deleted volume successfully.
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6cf75fb6-d980-4bf6-b1d2-9624b19e563b tempest-VolumesListAdminTestJSON-2043581445 None] Lock "cinder-d7fe1edb-a58f-4405-9509-a2e7333e7e26-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "cinder-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:04 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "cinder-quobyte-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.321s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Deleted volume successfully.
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-quobyte-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-14f07ec9-beed-4a04-97c1-e3ec326bd624 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-8322e966-3de0-40cd-a295-a1796d861d98-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1077cf-68eb-4cc8-b248-a8ec0cd69c76]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Acquiring lock "cinder-4ad56170-0362-4366-94fa-dbd6676063db-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:05 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189
Nov 05 18:41:05 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Lock "cinder-4ad56170-0362-4366-94fa-dbd6676063db-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Acquiring lock "cinder-quobyte-4ad56170-0362-4366-94fa-dbd6676063db" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Lock "cinder-quobyte-4ad56170-0362-4366-94fa-dbd6676063db" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd95637-d325-4351-860c-b253d8d0c746]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:05 devstack sudo[96840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db
Nov 05 18:41:05 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:05 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189" returned: 0 in 0.436s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:05 devstack sudo[96845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189
Nov 05 18:41:05 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:05 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db" returned: 0 in 0.419s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:05 devstack sudo[96851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db
Nov 05 18:41:05 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:05 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189" returned: 0 in 0.300s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-quobyte-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189" released by "delete_volume" :: held 0.789s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Created reservations ['ab0cb1ca-d59e-433d-9513-4304a107d412', '0998c02c-4d8e-4f4e-a7c4-3fdadc43784d', 'ead0be52-7d74-4a56-85d2-dd65c775c26e', 'df80a915-a699-4061-a617-b406fac0a9ff'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:05 devstack sudo[96853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:05 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:05 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4ad56170-0362-4366-94fa-dbd6676063db" returned: 0 in 0.292s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Lock "cinder-quobyte-4ad56170-0362-4366-94fa-dbd6676063db" released by "delete_volume" :: held 0.786s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Created reservations ['c48983d8-efad-4b64-8b74-6cce31e1e93f', '2eb1c376-8ca6-4924-80f5-9fb276403839', 'd384f48c-6fa2-4ce2-b600-29d0f2003280', 'e04ae924-28c0-4aed-9e3f-d30874363727'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "cinder-9be6e91e-afbd-42cb-9be0-9e88b93b09ed-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-9be6e91e-afbd-42cb-9be0-9e88b93b09ed-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:06 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:06 devstack sudo[96857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:06 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:06 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Deleted volume successfully.
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "cinder-quobyte-9be6e91e-afbd-42cb-9be0-9e88b93b09ed" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6e3eed63-aae5-4c57-aa07-3ccff0cc6bd7 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-e8168a7a-60f3-4a3a-bce4-13cb2cbe5189-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-quobyte-9be6e91e-afbd-42cb-9be0-9e88b93b09ed" acquired by "delete_volume" :: waited 0.040s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Acquiring lock "cinder-e77f73bc-46fe-4a23-885b-8351cf3531a2-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[59309c59-030f-47bb-93e5-d31715f5dfc3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Lock "cinder-e77f73bc-46fe-4a23-885b-8351cf3531a2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Acquiring lock "cinder-quobyte-e77f73bc-46fe-4a23-885b-8351cf3531a2" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Lock "cinder-quobyte-e77f73bc-46fe-4a23-885b-8351cf3531a2" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fedb6c-632e-4427-9e82-476956bd0833]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:06 devstack sudo[96859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed
Nov 05 18:41:06 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:06 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.371s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:06 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Deleted volume successfully.
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b952860d-62b0-4d53-8ff4-53383d58fb79 tempest-VolumesTestJSON-240740549 None] Lock "cinder-4ad56170-0362-4366-94fa-dbd6676063db-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:06 devstack sudo[96860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2
Nov 05 18:41:06 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:06 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed" returned: 0 in 0.436s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:06 devstack sudo[96868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed
Nov 05 18:41:06 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:06 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2" returned: 0 in 0.429s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:06 devstack sudo[96873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2
Nov 05 18:41:06 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:07 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9be6e91e-afbd-42cb-9be0-9e88b93b09ed" returned: 0 in 0.305s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-quobyte-9be6e91e-afbd-42cb-9be0-9e88b93b09ed" released by "delete_volume" :: held 0.815s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Created reservations ['39dc02fd-0121-4ce2-86e6-d3ff5cb6e095', 'b1f959f1-4d30-4a84-a2d6-d8a9eb34886c', '38d77300-0119-468e-8742-8441a277ec86', 'c2ddabc8-d885-4c32-8583-6ae31ca933a7'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:07 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e77f73bc-46fe-4a23-885b-8351cf3531a2" returned: 0 in 0.356s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Lock "cinder-quobyte-e77f73bc-46fe-4a23-885b-8351cf3531a2" released by "delete_volume" :: held 0.827s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:07 devstack sudo[96877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:07 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Created reservations ['34ad697c-04e9-4acd-b763-ee5f0175ea49', 'c6731d56-4d57-4d0b-b148-4152057b6a61', 'a93e8fbb-e570-4a76-b916-e1b4b5b3fe69', '1b5b739d-6521-4c93-bf12-649ee78e9a94'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:07 devstack sudo[96879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:07 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:07 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.298s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Acquiring lock "cinder-0a3e6681-952d-47e9-b568-0f7d6560a3d6-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:07 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Deleted volume successfully.
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Lock "cinder-0a3e6681-952d-47e9-b568-0f7d6560a3d6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8910786-49b6-4889-a67a-e13d3513d281 tempest-VolumesListAdminTestJSON-178103661 None] Lock "cinder-9be6e91e-afbd-42cb-9be0-9e88b93b09ed-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Acquiring lock "cinder-quobyte-0a3e6681-952d-47e9-b568-0f7d6560a3d6" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Lock "cinder-quobyte-0a3e6681-952d-47e9-b568-0f7d6560a3d6" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8880fcce-79ed-45ba-b0cd-f773a39eb565]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:07 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.309s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:07 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Deleted volume successfully.
Nov 05 18:41:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d59cace1-4dfe-4e81-815f-a52422191032 tempest-VolumesTestJSON-240740549 None] Lock "cinder-e77f73bc-46fe-4a23-885b-8351cf3531a2-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:07 devstack sudo[96883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6
Nov 05 18:41:07 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:08 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6" returned: 0 in 0.394s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:08 devstack sudo[96888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6
Nov 05 18:41:08 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:08 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0a3e6681-952d-47e9-b568-0f7d6560a3d6" returned: 0 in 0.267s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Lock "cinder-quobyte-0a3e6681-952d-47e9-b568-0f7d6560a3d6" released by "delete_volume" :: held 0.714s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Created reservations ['94c3af69-e682-428a-a37a-3a67ab84dd46', '7b465f19-d5e9-44fc-a025-ba057f7a59dc', '62ee7d72-86ca-490e-8301-63a27ed68b94', '9c77cf5e-e0a6-434f-ace1-e8b49df6b96a'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:08 devstack sudo[96891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:08 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:08 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.328s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:08 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Deleted volume successfully.
Nov 05 18:41:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-19bfa079-dc77-455e-bc66-b307f1a0dc44 tempest-VolumesTestJSON-240740549 None] Lock "cinder-0a3e6681-952d-47e9-b568-0f7d6560a3d6-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Flow 'volume_create_manager' (50551154-2aaf-46df-a7e4-332e2588d3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf821fd-d85c-4ecf-9bc1-15f1414cd7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf821fd-d85c-4ecf-9bc1-15f1414cd7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1707428560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79173d1e-aa1f-4404-b597-edccea1884be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d14916e24a44851bd1a9d286fa881b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:11Z,use_quota=True,user_id='24caf190e11b4ca396dc62f2496dd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7e2cd2-6c8a-452b-a81e-052c512ae90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7e2cd2-6c8a-452b-a81e-052c512ae90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e59fa15-e112-418e-816a-a14e6bc093c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e59fa15-e112-418e-816a-a14e6bc093c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79173d1e-aa1f-4404-b597-edccea1884be', 'volume_name': 'volume-79173d1e-aa1f-4404-b597-edccea1884be', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f79aaf-25a1-4c1b-9c8a-d47ba2b1c4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f79aaf-25a1-4c1b-9c8a-d47ba2b1c4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4399432-a303-44d9-a716-8d729f411943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:11 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Volume 79173d1e-aa1f-4404-b597-edccea1884be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79173d1e-aa1f-4404-b597-edccea1884be', 'volume_size': 1}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1707428560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79173d1e-aa1f-4404-b597-edccea1884be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d14916e24a44851bd1a9d286fa881b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:11Z,use_quota=True,user_id='24caf190e11b4ca396dc62f2496dd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Creating volume 79173d1e-aa1f-4404-b597-edccea1884be {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:11 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:11 devstack sudo[96897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be 1073741824
Nov 05 18:41:11 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:11 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be 1073741824" returned: 0 in 0.486s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:11 devstack sudo[96903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be
Nov 05 18:41:11 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:12 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be" returned: 0 in 0.259s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4399432-a303-44d9-a716-8d729f411943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79173d1e-aa1f-4404-b597-edccea1884be', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db71ac2-7d48-4a8d-895a-0be5b6139edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:12 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Volume volume-79173d1e-aa1f-4404-b597-edccea1884be (79173d1e-aa1f-4404-b597-edccea1884be): created successfully
Nov 05 18:41:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db71ac2-7d48-4a8d-895a-0be5b6139edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Flow 'volume_create_manager' (50551154-2aaf-46df-a7e4-332e2588d3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:12 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e09fcdb9-846b-47f1-8ac3-a453ef0a0aa1 tempest-AttachVolumeNegativeTest-1126432362 None] Created volume successfully.
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Flow 'volume_create_manager' (b5ad1e1b-3feb-487e-9240-04da25dba27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb4d787-9003-43c0-909a-3200a7894e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbb4d787-9003-43c0-909a-3200a7894e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-993711357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f5940d-0dcc-479f-86bf-1e71b428a04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c48717855643fe88659d968c92fe8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:14Z,use_quota=True,user_id='a48b27a7b0dd45a7ab3e5fbce2c9f6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed45c095-9d76-4ef1-8e88-30494a890090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed45c095-9d76-4ef1-8e88-30494a890090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1d2b4a-bbbd-4986-9f0a-b28a3591e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1d2b4a-bbbd-4986-9f0a-b28a3591e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f5940d-0dcc-479f-86bf-1e71b428a04a', 'volume_name': 'volume-45f5940d-0dcc-479f-86bf-1e71b428a04a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4e0a64-fcc0-4029-80a2-5794005b3420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4e0a64-fcc0-4029-80a2-5794005b3420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7136bfd-5e78-4448-9e33-a56802d9fcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:14 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Volume 45f5940d-0dcc-479f-86bf-1e71b428a04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f5940d-0dcc-479f-86bf-1e71b428a04a', 'volume_size': 1}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-993711357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f5940d-0dcc-479f-86bf-1e71b428a04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c48717855643fe88659d968c92fe8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:14Z,use_quota=True,user_id='a48b27a7b0dd45a7ab3e5fbce2c9f6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Creating volume 45f5940d-0dcc-479f-86bf-1e71b428a04a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:14 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:14 devstack sudo[96919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a 1073741824
Nov 05 18:41:14 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-91686842-2cf3-4eaa-9c7b-a608b88608dd tempest-GroupSnapshotsTest-46186209 None] Group tempest-GroupSnapshotsTest-Group-1458449308: creating
Nov 05 18:41:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-91686842-2cf3-4eaa-9c7b-a608b88608dd tempest-GroupSnapshotsTest-46186209 None] Group tempest-GroupSnapshotsTest-Group-1458449308: created successfully
Nov 05 18:41:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-91686842-2cf3-4eaa-9c7b-a608b88608dd tempest-GroupSnapshotsTest-46186209 None] Create group completed successfully.
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-9070423b-8616-4f97-81a4-a701a4393026 req-e7ff6cb5-ee75-4443-907b-8c4bf9f97e2a tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:14 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a 1073741824" returned: 0 in 0.531s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:14 devstack sudo[96928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a
Nov 05 18:41:14 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:15 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-9070423b-8616-4f97-81a4-a701a4393026 req-e7ff6cb5-ee75-4443-907b-8c4bf9f97e2a tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.630s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-9070423b-8616-4f97-81a4-a701a4393026 req-e7ff6cb5-ee75-4443-907b-8c4bf9f97e2a tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7136bfd-5e78-4448-9e33-a56802d9fcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f5940d-0dcc-479f-86bf-1e71b428a04a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa227247-8347-4a7a-89e0-97150466546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:15 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Volume volume-45f5940d-0dcc-479f-86bf-1e71b428a04a (45f5940d-0dcc-479f-86bf-1e71b428a04a): created successfully
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa227247-8347-4a7a-89e0-97150466546e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Flow 'volume_create_manager' (b5ad1e1b-3feb-487e-9240-04da25dba27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-9070423b-8616-4f97-81a4-a701a4393026 req-e7ff6cb5-ee75-4443-907b-8c4bf9f97e2a tempest-AttachVolumeNegativeTest-1126432362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-79173d1e-aa1f-4404-b597-edccea1884be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '846c7ccc-4113-40c7-bed0-21e00a613cc0', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:41:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a8a9c43e-279e-4141-9157-3a7ad8b6116f tempest-AbsoluteLimitsTests-1633586537 None] Created volume successfully.
Nov 05 18:41:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-9070423b-8616-4f97-81a4-a701a4393026 req-e7ff6cb5-ee75-4443-907b-8c4bf9f97e2a tempest-AttachVolumeNegativeTest-1126432362 None] attachment_update completed successfully.
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-e8899778-029f-46fb-8d62-5a80478c69ea req-db029138-b7e7-468b-b0dd-575841e64ce3 tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-e8899778-029f-46fb-8d62-5a80478c69ea req-db029138-b7e7-468b-b0dd-575841e64ce3 tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-e8899778-029f-46fb-8d62-5a80478c69ea req-db029138-b7e7-468b-b0dd-575841e64ce3 tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-e8899778-029f-46fb-8d62-5a80478c69ea req-db029138-b7e7-468b-b0dd-575841e64ce3 tempest-TestServerVolumeAttachmentScenario-258812409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-f81a620d-ac16-4f47-90f3-a998cd09193c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11726023-0b1e-4c72-9dba-9fe1cd3cf618', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:41:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-e8899778-029f-46fb-8d62-5a80478c69ea req-db029138-b7e7-468b-b0dd-575841e64ce3 tempest-TestServerVolumeAttachmentScenario-258812409 None] attachment_update completed successfully.
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Flow 'volume_create_manager' (26169218-a9b2-432c-b4c9-1b852bb5b599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98e458c-97f1-4e53-a20f-7a5d13075110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98e458c-97f1-4e53-a20f-7a5d13075110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945301274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=53eb2a61-e3ed-4696-8eb9-9186222eef61,host='devstack@QuobyteHD#QuobyteHD',id=a1d7c027-5490-4a3f-b958-8839dd28d98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e226df52b3394276a78fb1edb638e722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:16Z,use_quota=True,user_id='8ad77bc416b34ac1bd19d75590cf443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddb19182-f06d-4c05-9695-e373acc16da6),volume_type_id=ddb19182-f06d-4c05-9695-e373acc16da6)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f256b14d-4b26-4a4e-a64a-d399a66c448e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f256b14d-4b26-4a4e-a64a-d399a66c448e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e008925-4520-44b3-aed4-fe0854d0bfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e008925-4520-44b3-aed4-fe0854d0bfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d7c027-5490-4a3f-b958-8839dd28d98c', 'volume_name': 'volume-a1d7c027-5490-4a3f-b958-8839dd28d98c', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cf8426-dc60-4795-a89a-e42a458003ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cf8426-dc60-4795-a89a-e42a458003ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af261d4-c0ff-433d-810f-637fa20ef936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:16 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Volume a1d7c027-5490-4a3f-b958-8839dd28d98c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d7c027-5490-4a3f-b958-8839dd28d98c', 'volume_size': 1}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=53eb2a61-e3ed-4696-8eb9-9186222eef61,created_at=2026-11-05T17:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945301274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=53eb2a61-e3ed-4696-8eb9-9186222eef61,host='devstack@QuobyteHD#QuobyteHD',id=a1d7c027-5490-4a3f-b958-8839dd28d98c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e226df52b3394276a78fb1edb638e722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:16Z,use_quota=True,user_id='8ad77bc416b34ac1bd19d75590cf443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddb19182-f06d-4c05-9695-e373acc16da6),volume_type_id=ddb19182-f06d-4c05-9695-e373acc16da6)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Creating volume a1d7c027-5490-4a3f-b958-8839dd28d98c {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:16 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:16 devstack sudo[97359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c 1073741824
Nov 05 18:41:16 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Acquiring lock "cinder-45f5940d-0dcc-479f-86bf-1e71b428a04a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Lock "cinder-45f5940d-0dcc-479f-86bf-1e71b428a04a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Acquiring lock "cinder-quobyte-45f5940d-0dcc-479f-86bf-1e71b428a04a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Lock "cinder-quobyte-45f5940d-0dcc-479f-86bf-1e71b428a04a" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[7625fa6d-5933-49de-a67d-aafbceb832c9]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:16 devstack sudo[97364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a
Nov 05 18:41:16 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:17 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c 1073741824" returned: 0 in 0.569s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:17 devstack sudo[97367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c
Nov 05 18:41:17 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a" returned: 0 in 0.453s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:17 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:17 devstack sudo[97373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a
Nov 05 18:41:17 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:17 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c" returned: 0 in 0.334s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af261d4-c0ff-433d-810f-637fa20ef936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d7c027-5490-4a3f-b958-8839dd28d98c', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13077a1-3140-4aaf-a82d-70e7d79f8d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:17 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Volume volume-a1d7c027-5490-4a3f-b958-8839dd28d98c (a1d7c027-5490-4a3f-b958-8839dd28d98c): created successfully
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13077a1-3140-4aaf-a82d-70e7d79f8d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Flow 'volume_create_manager' (26169218-a9b2-432c-b4c9-1b852bb5b599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:17 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f8ae23a9-fa7d-454b-ba5e-6134dcfe74ff tempest-GroupSnapshotsTest-46186209 None] Created volume successfully.
Nov 05 18:41:17 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-45f5940d-0dcc-479f-86bf-1e71b428a04a" returned: 0 in 0.292s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Lock "cinder-quobyte-45f5940d-0dcc-479f-86bf-1e71b428a04a" released by "delete_volume" :: held 0.795s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Created reservations ['12c26ba7-9cf8-4bc6-ab03-0b2ab3ff1c15', 'b497efc3-9236-470e-9cc7-e5db7ff7287c', 'be3fbb81-deea-4708-b828-ab9ad78d75e7', 'c9033bda-988f-4dbd-afb8-06342135e3a8'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:17 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-2e95ae70-3b16-47cf-ab0b-0252bc7593ed req-4ece5184-c72e-4cb2-9fd8-1d37b1f830ed tempest-AttachVolumeNegativeTest-1126432362 None] Terminate volume connection completed successfully.
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-2e95ae70-3b16-47cf-ab0b-0252bc7593ed req-4ece5184-c72e-4cb2-9fd8-1d37b1f830ed tempest-AttachVolumeNegativeTest-1126432362 None] Deleting attachment 846c7ccc-4113-40c7-bed0-21e00a613cc0. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:17 devstack sudo[97379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:17 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:18 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.351s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:18 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Deleted volume successfully.
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a01a9446-4cf7-4308-8b3c-4aa00568b090 tempest-AbsoluteLimitsTests-1633586537 None] Lock "cinder-45f5940d-0dcc-479f-86bf-1e71b428a04a-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:18 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] GroupSnapshot 6df9ffee-f396-4016-8e30-c27b6a978d32: creating.
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Group snapshot 6df9ffee-f396-4016-8e30-c27b6a978d32: creating. {{(pid=87086) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Creating offline snapshot 8eca379c-888f-4de9-99fd-ae9a1ea73553 of volume a1d7c027-5490-4a3f-b958-8839dd28d98c {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e7ae0c-8b8d-4650-bf5c-a19911f8cac7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:18 devstack sudo[97382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c
Nov 05 18:41:18 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:18 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c" returned: 0 in 0.556s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:18 devstack sudo[97388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 1G
Nov 05 18:41:18 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:19 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 1G" returned: 0 in 0.793s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d7c027-5490-4a3f-b958-8839dd28d98c -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:19 devstack sudo[97415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d7c027-5490-4a3f-b958-8839dd28d98c -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553
Nov 05 18:41:19 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:20 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1d7c027-5490-4a3f-b958-8839dd28d98c -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553" returned: 0 in 0.403s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:20 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:41:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:20 devstack sudo[97420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553
Nov 05 18:41:20 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:20 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553" returned: 0 in 0.331s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:20 devstack sudo[97424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.info
Nov 05 18:41:20 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:20 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.info" returned: 0 in 0.363s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:20 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:41:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:20 devstack sudo[97428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.info
Nov 05 18:41:20 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:21 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.info" returned: 0 in 0.414s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b7bf6883-9cb5-4d00-baf2-452881d34530 tempest-GroupSnapshotsTest-46186209 None] group_snapshot 6df9ffee-f396-4016-8e30-c27b6a978d32: created successfully
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-bf915fa3-d4d2-4fab-a1f3-7ed63470708a req-08d9ca19-a9b1-4f6a-b1fb-795275a89d63 tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-bf915fa3-d4d2-4fab-a1f3-7ed63470708a req-08d9ca19-a9b1-4f6a-b1fb-795275a89d63 tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-bf915fa3-d4d2-4fab-a1f3-7ed63470708a req-08d9ca19-a9b1-4f6a-b1fb-795275a89d63 tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-bf915fa3-d4d2-4fab-a1f3-7ed63470708a req-08d9ca19-a9b1-4f6a-b1fb-795275a89d63 tempest-TestServerVolumeAttachmentScenario-258812409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-727a4afd-33dd-4759-89b9-3952308076da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '884e75c7-5e21-4e02-9b10-a860e8f1bce9', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:41:22 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-bf915fa3-d4d2-4fab-a1f3-7ed63470708a req-08d9ca19-a9b1-4f6a-b1fb-795275a89d63 tempest-TestServerVolumeAttachmentScenario-258812409 None] attachment_update completed successfully.
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-8eca379c-888f-4de9-99fd-ae9a1ea73553-8242f5b8-e127-474c-9295-fe5612a96ec2" by "_create_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-8eca379c-888f-4de9-99fd-ae9a1ea73553-8242f5b8-e127-474c-9295-fe5612a96ec2" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Creating volume 8242f5b8-e127-474c-9295-fe5612a96ec2 from snapshot 8eca379c-888f-4de9-99fd-ae9a1ea73553 {{(pid=87086) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-8242f5b8-e127-474c-9295-fe5612a96ec2" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-8242f5b8-e127-474c-9295-fe5612a96ec2" acquired by "_copy_volume_from_snapshot" :: waited 0.075s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] snapshot: 8eca379c-888f-4de9-99fd-ae9a1ea73553, volume: 8242f5b8-e127-474c-9295-fe5612a96ec2,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e622a028-efc4-48f2-a50a-219b6773f483]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:23 devstack sudo[97445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553
Nov 05 18:41:23 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:23 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553" returned: 0 in 0.539s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d7c027-5490-4a3f-b958-8839dd28d98c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3849755-4b24-4239-b27a-951486fbb4c1]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:23 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c
Nov 05 18:41:23 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:24 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c" returned: 0 in 0.431s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:41:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:41:24 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2 not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:41:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:24 devstack sudo[97455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2
Nov 05 18:41:24 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:41:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:25 devstack sudo[97470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:25 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:25 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-88af8b98-2d24-478a-ab0c-ea02f030a20d req-1ef313d1-d957-4c90-9f79-7f698e9a989a tempest-TestServerVolumeAttachmentScenario-258812409 None] Terminate volume connection completed successfully.
Nov 05 18:41:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-88af8b98-2d24-478a-ab0c-ea02f030a20d req-1ef313d1-d957-4c90-9f79-7f698e9a989a tempest-TestServerVolumeAttachmentScenario-258812409 None] Deleting attachment 884e75c7-5e21-4e02-9b10-a860e8f1bce9. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:41:26 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.744s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:26 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:41:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:41:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Flow 'volume_create_manager' (2247f68c-69f3-46a4-b877-4f149d1ca1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92252a7f-c6a7-420e-a6f5-1becab3f900b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92252a7f-c6a7-420e-a6f5-1becab3f900b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1846376533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ae9cc2-d721-4995-aaa9-8569c899a9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c9289e96ac4d5297f98bebb0c32452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:28Z,use_quota=True,user_id='7168c9c954a54cec8a2a0c65b5445269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e0201c-46b8-4ffe-984d-44df1e838a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e0201c-46b8-4ffe-984d-44df1e838a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa8910c-e42d-41aa-b921-48972712193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa8910c-e42d-41aa-b921-48972712193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ae9cc2-d721-4995-aaa9-8569c899a9de', 'volume_name': 'volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c657b6-39eb-459f-b713-449b11bb71c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c657b6-39eb-459f-b713-449b11bb71c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6421b91-be46-441b-9386-5badacffff7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:28 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Volume f9ae9cc2-d721-4995-aaa9-8569c899a9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de', 'volume_size': 1}
Nov 05 18:41:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-b2de9a9e-7464-4f76-bd26-87764d83d5b6 req-897f0f89-cb95-4b32-badc-d488f8e2a168 tempest-TestServerVolumeAttachmentScenario-258812409 None] Terminate volume connection completed successfully.
Nov 05 18:41:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-b2de9a9e-7464-4f76-bd26-87764d83d5b6 req-897f0f89-cb95-4b32-badc-d488f8e2a168 tempest-TestServerVolumeAttachmentScenario-258812409 None] Deleting attachment 11726023-0b1e-4c72-9dba-9fe1cd3cf618. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:41:33 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2" returned: 0 in 9.209s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c, size 1024.00 MB, duration 9.21 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:41:33 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Converted 1024.00 MB image at 111.18 MB/s
Nov 05 18:41:33 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:33 devstack sudo[97538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2
Nov 05 18:41:33 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:33 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2" returned: 0 in 0.276s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-8242f5b8-e127-474c-9295-fe5612a96ec2" released by "_copy_volume_from_snapshot" :: held 10.658s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-8eca379c-888f-4de9-99fd-ae9a1ea73553-8242f5b8-e127-474c-9295-fe5612a96ec2" released by "_create_volume_from_snapshot" :: held 10.814s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.852s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.164s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1846376533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ae9cc2-d721-4995-aaa9-8569c899a9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c9289e96ac4d5297f98bebb0c32452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:28Z,use_quota=True,user_id='7168c9c954a54cec8a2a0c65b5445269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Creating volume f9ae9cc2-d721-4995-aaa9-8569c899a9de {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:33 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:41:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:33 devstack sudo[97547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de 1073741824
Nov 05 18:41:33 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e58d97cc-2d3d-458e-8242-d3bb22f9b6ec tempest-GroupSnapshotsTest-46186209 None] Create group from source-snapshot-6df9ffee-f396-4016-8e30-c27b6a978d32 completed successfully.
Nov 05 18:41:34 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de 1073741824" returned: 0 in 0.760s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:34 devstack sudo[97558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de
Nov 05 18:41:34 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-8242f5b8-e127-474c-9295-fe5612a96ec2" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:34 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-8242f5b8-e127-474c-9295-fe5612a96ec2" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de" returned: 0 in 0.330s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6421b91-be46-441b-9386-5badacffff7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f3fb94-b162-47e1-a79d-0f3f16807d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b2c961-47d5-4123-a87c-3bd96ca1656b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:34 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Volume volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de (f9ae9cc2-d721-4995-aaa9-8569c899a9de): created successfully
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f3fb94-b162-47e1-a79d-0f3f16807d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Flow 'volume_create_manager' (2247f68c-69f3-46a4-b877-4f149d1ca1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:34 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a9df8dfb-4416-4e5d-b6c8-c88263a7be6b tempest-VolumesTransfersTest-1634108482 None] Created volume successfully.
Nov 05 18:41:34 devstack sudo[97561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2
Nov 05 18:41:34 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:35 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2" returned: 0 in 0.435s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:35 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2
Nov 05 18:41:35 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:35 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8242f5b8-e127-474c-9295-fe5612a96ec2" returned: 0 in 0.397s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-8242f5b8-e127-474c-9295-fe5612a96ec2" released by "delete_volume" :: held 0.917s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:35 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Created reservations ['a2c8c551-059a-4760-aafa-5ac709f0a0b5'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:35 devstack cinder-volume[87086]: WARNING cinder.quota [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-533384413 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-533384413, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:41:35 devstack cinder-volume[87086]: WARNING cinder.quota [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-533384413 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-533384413, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:41:35 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Created reservations ['3147b636-e5f9-453f-8fcd-579287650e77', 'a6068478-3ac8-4253-aec8-9fa2acd6d54f', '21039f68-20a6-4d10-a406-9be7fe340f44', '984faa60-3ae9-46df-9d46-5c2e2283e1df'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:36 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:36 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-4e6553c9-77ec-4088-b611-8673a2f66dd9 tempest-VolumesTransfersTest-1304786930 None] Transfer volume completed successfully.
Nov 05 18:41:36 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.293s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f0fbbe4a-f470-4f27-8922-5ccfc6a153b9 tempest-GroupSnapshotsTest-46186209 None] Delete group completed successfully.
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "cinder-727a4afd-33dd-4759-89b9-3952308076da-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "cinder-727a4afd-33dd-4759-89b9-3952308076da-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "cinder-quobyte-727a4afd-33dd-4759-89b9-3952308076da" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "cinder-quobyte-727a4afd-33dd-4759-89b9-3952308076da" acquired by "delete_volume" :: waited 0.047s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[86276307-4b6f-4b34-a003-959a85a63c0c]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:37 devstack sudo[97592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da
Nov 05 18:41:37 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:37 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] group_snapshot 6df9ffee-f396-4016-8e30-c27b6a978d32: deleting
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] group_snapshot 6df9ffee-f396-4016-8e30-c27b6a978d32: deleting {{(pid=87086) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-a1d7c027-5490-4a3f-b958-8839dd28d98c" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-a1d7c027-5490-4a3f-b958-8839dd28d98c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-8eca379c-888f-4de9-99fd-ae9a1ea73553" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-8eca379c-888f-4de9-99fd-ae9a1ea73553" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Deleting offline snapshot 8eca379c-888f-4de9-99fd-ae9a1ea73553 of volume a1d7c027-5490-4a3f-b958-8839dd28d98c {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] snapshot_file for this snap is: volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[58468a3a-9506-414c-9991-34726b60a6ef]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:37 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da" returned: 0 in 0.900s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Acquiring lock "cinder-f9ae9cc2-d721-4995-aaa9-8569c899a9de-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:37 devstack sudo[97644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da
Nov 05 18:41:37 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Lock "cinder-f9ae9cc2-d721-4995-aaa9-8569c899a9de-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:37 devstack sudo[97639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553
Nov 05 18:41:37 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Acquiring lock "cinder-quobyte-f9ae9cc2-d721-4995-aaa9-8569c899a9de" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Lock "cinder-quobyte-f9ae9cc2-d721-4995-aaa9-8569c899a9de" acquired by "delete_volume" :: waited 0.035s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25ba881-f13c-4553-8c3b-259cf654801c]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:38 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-727a4afd-33dd-4759-89b9-3952308076da" returned: 0 in 0.582s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:38 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "cinder-quobyte-727a4afd-33dd-4759-89b9-3952308076da" released by "delete_volume" :: held 1.588s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553" returned: 0 in 0.792s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1d7c027-5490-4a3f-b958-8839dd28d98c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:41:38 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de
Nov 05 18:41:38 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d642e8de-b91c-4bc0-b3b3-3c79a2f48334]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Created reservations ['2a34ea19-e599-486a-b949-7438eb96befa', '98d1520a-ccfd-40eb-a168-172d805ece7b', '4ea0f9a9-c87a-4306-aa76-f60821389e25', 'dc9ff11e-0aeb-40b9-86be-6802b5df9b61'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:38 devstack sudo[97659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c
Nov 05 18:41:38 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:38 devstack sudo[97664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:38 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:38 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de" returned: 0 in 0.623s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:38 devstack sudo[97669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de
Nov 05 18:41:38 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:39 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.569s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Deleted volume successfully.
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dc8dd865-80f3-4ab5-b55d-7b3ade6331af tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "cinder-727a4afd-33dd-4759-89b9-3952308076da-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "cinder-f81a620d-ac16-4f47-90f3-a998cd09193c-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:39 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f9ae9cc2-d721-4995-aaa9-8569c899a9de" returned: 0 in 0.590s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Lock "cinder-quobyte-f9ae9cc2-d721-4995-aaa9-8569c899a9de" released by "delete_volume" :: held 1.310s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "cinder-f81a620d-ac16-4f47-90f3-a998cd09193c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:39 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "cinder-quobyte-f81a620d-ac16-4f47-90f3-a998cd09193c" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c" returned: 0 in 1.069s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "cinder-quobyte-f81a620d-ac16-4f47-90f3-a998cd09193c" acquired by "delete_volume" :: waited 0.038s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:39 devstack sudo[97676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553
Nov 05 18:41:39 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ad550c-ae1c-4e02-80be-a48d8a3396aa]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Created reservations ['9e7e5a9f-bb8b-4f3a-876b-77e8139f332d', '1d9cc247-d891-4cfc-b9fd-6dfd1a2506c4', 'fe220a1f-5c2e-48aa-8a45-e8faf51a04c7', '46044bb8-1fae-451a-8540-b88555e1235d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:39 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c
Nov 05 18:41:39 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:39 devstack sudo[97679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:39 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:40 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:40 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553" returned: 0 in 0.547s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.332s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:40 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Deleted volume successfully.
Nov 05 18:41:40 devstack sudo[97690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553
Nov 05 18:41:40 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9de5229e-2c3a-43be-a14b-92a6786df9ac tempest-VolumesTransfersTest-1675509322 None] Lock "cinder-f9ae9cc2-d721-4995-aaa9-8569c899a9de-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:40 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c" returned: 0 in 0.557s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:40 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c
Nov 05 18:41:40 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:40 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c.8eca379c-888f-4de9-99fd-ae9a1ea73553" returned: 0 in 0.323s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-8eca379c-888f-4de9-99fd-ae9a1ea73553" released by "_delete_snapshot" :: held 2.894s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-a1d7c027-5490-4a3f-b958-8839dd28d98c" released by "delete_snapshot" :: held 2.942s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:40 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f81a620d-ac16-4f47-90f3-a998cd09193c" returned: 0 in 0.333s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "cinder-quobyte-f81a620d-ac16-4f47-90f3-a998cd09193c" released by "delete_volume" :: held 0.985s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Created reservations ['3488c984-56aa-4bfe-92a9-5f29e381e724', '41e89b1c-526f-4265-9231-7b6aaedeb769', '23f18be9-2931-42a0-a0a9-26024745ae71', 'b4a96f8a-07a1-4f99-8f5e-44bec4944b1f'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:40 devstack cinder-volume[87086]: WARNING cinder.quota [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-533384413 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-533384413, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] Created reservations ['aa6a6b7c-a60d-48c5-a38e-c274ea6d7af3', 'f835c24e-90ee-43f0-b543-ec2f262467db', '38811195-e4b1-421d-8d26-516046bc554f', '1fe6c66e-e803-4360-a7b3-062c0af289af'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:40 devstack sudo[97697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:40 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:41 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f3449b79-75ff-41a5-93a8-e569a4e7ee97 tempest-GroupSnapshotsTest-46186209 None] group_snapshot 6df9ffee-f396-4016-8e30-c27b6a978d32: deleted successfully
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Flow 'volume_create_manager' (5658b9fe-4f12-46b7-984c-25873053c223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:41 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4699f51-9fad-4e41-97e4-9baf32fb8288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.513s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4699f51-9fad-4e41-97e4-9baf32fb8288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-810385940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe67944-4422-4084-a29e-dc7d71a4db1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c9289e96ac4d5297f98bebb0c32452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:41Z,use_quota=True,user_id='7168c9c954a54cec8a2a0c65b5445269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b217d7-4369-4ddf-bd6a-6d6c9a45128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b217d7-4369-4ddf-bd6a-6d6c9a45128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f779b38c-8e6f-4d73-a4d7-fd0de7c03659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f779b38c-8e6f-4d73-a4d7-fd0de7c03659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbe67944-4422-4084-a29e-dc7d71a4db1f', 'volume_name': 'volume-cbe67944-4422-4084-a29e-dc7d71a4db1f', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a53f24-ffb4-40c6-88e2-cd08a1a6da78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a53f24-ffb4-40c6-88e2-cd08a1a6da78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfec8017-b6cc-4c85-b4d5-ddc32b0cd699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:41 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Volume cbe67944-4422-4084-a29e-dc7d71a4db1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbe67944-4422-4084-a29e-dc7d71a4db1f', 'volume_size': 1}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-810385940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe67944-4422-4084-a29e-dc7d71a4db1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c9289e96ac4d5297f98bebb0c32452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:41Z,use_quota=True,user_id='7168c9c954a54cec8a2a0c65b5445269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Creating volume cbe67944-4422-4084-a29e-dc7d71a4db1f {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:41 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:41 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Deleted volume successfully.
Nov 05 18:41:41 devstack sudo[97702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f 1073741824
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-76a3dfd5-d145-458a-817a-a32e73820ae4 tempest-TestServerVolumeAttachmentScenario-258812409 None] Lock "cinder-f81a620d-ac16-4f47-90f3-a998cd09193c-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:41 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-a1d7c027-5490-4a3f-b958-8839dd28d98c" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-a1d7c027-5490-4a3f-b958-8839dd28d98c" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e96dc09-84bb-42fe-80d3-fe3a940e9bdd]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:41 devstack sudo[97704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c
Nov 05 18:41:41 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:42 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:42 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f 1073741824" returned: 0 in 0.808s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c" returned: 0 in 0.620s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:42 devstack sudo[97712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c
Nov 05 18:41:42 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:42 devstack sudo[97714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f
Nov 05 18:41:42 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:42 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f" returned: 0 in 0.547s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfec8017-b6cc-4c85-b4d5-ddc32b0cd699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe67944-4422-4084-a29e-dc7d71a4db1f', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6179b0c-2f41-42a7-944c-9095e27ab957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:42 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a1d7c027-5490-4a3f-b958-8839dd28d98c" returned: 0 in 0.742s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:42 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Volume volume-cbe67944-4422-4084-a29e-dc7d71a4db1f (cbe67944-4422-4084-a29e-dc7d71a4db1f): created successfully
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6179b0c-2f41-42a7-944c-9095e27ab957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Flow 'volume_create_manager' (5658b9fe-4f12-46b7-984c-25873053c223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-a1d7c027-5490-4a3f-b958-8839dd28d98c" released by "delete_volume" :: held 1.490s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fc3ad32c-3b75-41eb-b874-66961e8be227 tempest-VolumesTransfersTest-1634108482 None] Created volume successfully.
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Created reservations ['559398ac-f0e3-4b96-aa2e-8e96523331f7'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:43 devstack cinder-volume[87086]: WARNING cinder.db.api [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-533384413']
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Created reservations ['c67a8333-d4b0-4214-b65a-ccbdec111772', 'fc054e65-824e-441f-b73b-d0f4f5ee28be', 'ff711317-9c48-45c6-bbb6-603ec2edd5c5', '1701f4d2-2419-46a2-ab14-99f9e93e0f26'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:43 devstack sudo[97720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:43 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:43 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.363s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:43 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0621b464-ad7b-47e1-93e2-35f3b16e39aa tempest-GroupSnapshotsTest-46186209 None] Delete group completed successfully.
Nov 05 18:41:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Acquiring lock "cinder-cbe67944-4422-4084-a29e-dc7d71a4db1f-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Lock "cinder-cbe67944-4422-4084-a29e-dc7d71a4db1f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Acquiring lock "cinder-quobyte-cbe67944-4422-4084-a29e-dc7d71a4db1f" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:41:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Lock "cinder-quobyte-cbe67944-4422-4084-a29e-dc7d71a4db1f" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:41:44 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eeb131-d3f8-41f0-bb04-553b5df6687d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:44 devstack sudo[97723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f
Nov 05 18:41:44 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2b6dfed7-9b40-4824-8537-372e4a8b86e1 tempest-GroupSnapshotsTest-46186209 None] Group tempest-GroupSnapshotsTest-Group-637579543: creating
Nov 05 18:41:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2b6dfed7-9b40-4824-8537-372e4a8b86e1 tempest-GroupSnapshotsTest-46186209 None] Group tempest-GroupSnapshotsTest-Group-637579543: created successfully
Nov 05 18:41:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2b6dfed7-9b40-4824-8537-372e4a8b86e1 tempest-GroupSnapshotsTest-46186209 None] Create group completed successfully.
Nov 05 18:41:45 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f" returned: 0 in 0.856s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:45 devstack sudo[97769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f
Nov 05 18:41:45 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:45 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cbe67944-4422-4084-a29e-dc7d71a4db1f" returned: 0 in 0.369s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Lock "cinder-quobyte-cbe67944-4422-4084-a29e-dc7d71a4db1f" released by "delete_volume" :: held 1.288s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Created reservations ['fbf03cd5-1329-4d86-b05f-d5e8dfc25a81', '38f450db-c055-4ef8-9498-54e36f67b23b', '4b17d2e0-f90d-405d-a44e-afdb33a6e790', 'e2a0b719-1a14-42d7-96b4-3d79ab725c48'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:45 devstack sudo[97775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:41:45 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:45 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.310s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:41:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Deleted volume successfully.
Nov 05 18:41:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-457d5007-2416-4f06-961a-e00a1be6fd03 tempest-VolumesTransfersTest-1675509322 None] Lock "cinder-cbe67944-4422-4084-a29e-dc7d71a4db1f-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Flow 'volume_create_manager' (d869ab65-78f3-4eae-a386-cf4cbe790c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57aa4ddc-bc49-4210-8774-68c281198a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57aa4ddc-bc49-4210-8774-68c281198a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2091198162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6372fd8c-4907-4f4c-bf7f-8c2cc3a71358,host='devstack@QuobyteHD#QuobyteHD',id=4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e226df52b3394276a78fb1edb638e722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:47Z,use_quota=True,user_id='8ad77bc416b34ac1bd19d75590cf443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82e1db6e-eb7e-4d59-a2b7-3952733d1888),volume_type_id=82e1db6e-eb7e-4d59-a2b7-3952733d1888)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3a8432-a180-4f0a-a4cb-e8e4d3771f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3a8432-a180-4f0a-a4cb-e8e4d3771f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00c1823-9fb7-4be1-8ce2-e57976b3b973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00c1823-9fb7-4be1-8ce2-e57976b3b973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a', 'volume_name': 'volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2f38d7-5e2e-4945-a2b8-b3b99981dd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2f38d7-5e2e-4945-a2b8-b3b99981dd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01b7e60-49de-40f8-a0b8-b5792244119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:46 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Volume 4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a', 'volume_size': 1}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6372fd8c-4907-4f4c-bf7f-8c2cc3a71358,created_at=2026-11-05T17:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2091198162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6372fd8c-4907-4f4c-bf7f-8c2cc3a71358,host='devstack@QuobyteHD#QuobyteHD',id=4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e226df52b3394276a78fb1edb638e722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:47Z,use_quota=True,user_id='8ad77bc416b34ac1bd19d75590cf443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82e1db6e-eb7e-4d59-a2b7-3952733d1888),volume_type_id=82e1db6e-eb7e-4d59-a2b7-3952733d1888)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Creating volume 4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:46 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:41:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:46 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a 1073741824
Nov 05 18:41:46 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:47 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a 1073741824" returned: 0 in 0.820s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:47 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=176,cinder:SELECT=145,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:41:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:47 devstack sudo[97794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a
Nov 05 18:41:47 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:48 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" returned: 0 in 0.457s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:48 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=150,cinder:UPDATE=169,cinder:DELETE=12,cinder:INSERT=40 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:41:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01b7e60-49de-40f8-a0b8-b5792244119e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34216b0-f82a-44b3-9696-356ba9a06ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:48 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Volume volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a (4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a): created successfully
Nov 05 18:41:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34216b0-f82a-44b3-9696-356ba9a06ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Flow 'volume_create_manager' (d869ab65-78f3-4eae-a386-cf4cbe790c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:48 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a711ab4b-031c-42cc-9058-f7daa5b7d348 tempest-GroupSnapshotsTest-46186209 None] Created volume successfully.
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Flow 'volume_create_manager' (adf473a1-d877-4e6f-bf0a-b925441e9e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8b851a-f0bf-4dc5-b3ec-09d44cddaedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8b851a-f0bf-4dc5-b3ec-09d44cddaedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1468479982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6372fd8c-4907-4f4c-bf7f-8c2cc3a71358,host='devstack@QuobyteHD#QuobyteHD',id=77c5c68d-c95e-4545-8ebf-2a8c55af5796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e226df52b3394276a78fb1edb638e722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:50Z,use_quota=True,user_id='8ad77bc416b34ac1bd19d75590cf443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82e1db6e-eb7e-4d59-a2b7-3952733d1888),volume_type_id=82e1db6e-eb7e-4d59-a2b7-3952733d1888)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ffe42c-94ce-4332-b36a-9a032988eee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ffe42c-94ce-4332-b36a-9a032988eee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27cc8eb-d516-452c-be77-f36183672bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27cc8eb-d516-452c-be77-f36183672bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c5c68d-c95e-4545-8ebf-2a8c55af5796', 'volume_name': 'volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b67e1b-7942-423b-83d9-5079b67aced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b67e1b-7942-423b-83d9-5079b67aced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef42bdd-936f-4a61-ac18-4692ec06a46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:50 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Volume 77c5c68d-c95e-4545-8ebf-2a8c55af5796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796', 'volume_size': 1}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6372fd8c-4907-4f4c-bf7f-8c2cc3a71358,created_at=2026-11-05T17:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1468479982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6372fd8c-4907-4f4c-bf7f-8c2cc3a71358,host='devstack@QuobyteHD#QuobyteHD',id=77c5c68d-c95e-4545-8ebf-2a8c55af5796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e226df52b3394276a78fb1edb638e722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:50Z,use_quota=True,user_id='8ad77bc416b34ac1bd19d75590cf443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82e1db6e-eb7e-4d59-a2b7-3952733d1888),volume_type_id=82e1db6e-eb7e-4d59-a2b7-3952733d1888)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Creating volume 77c5c68d-c95e-4545-8ebf-2a8c55af5796 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:50 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:41:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:50 devstack sudo[97798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 1073741824
Nov 05 18:41:50 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:51 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 1073741824" returned: 0 in 0.753s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:51 devstack sudo[97804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796
Nov 05 18:41:51 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:51 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796" returned: 0 in 0.349s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef42bdd-936f-4a61-ac18-4692ec06a46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71b010a-421d-4205-9083-2853f4529e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:51 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Volume volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 (77c5c68d-c95e-4545-8ebf-2a8c55af5796): created successfully
Nov 05 18:41:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71b010a-421d-4205-9083-2853f4529e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Flow 'volume_create_manager' (adf473a1-d877-4e6f-bf0a-b925441e9e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:51 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-da8ad6c6-eda5-4f5b-9015-3fcb62c673c0 tempest-GroupSnapshotsTest-46186209 None] Created volume successfully.
Nov 05 18:41:52 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fd723111-d088-4088-8f93-07f77c494d76 tempest-GroupSnapshotsTest-46186209 None] Update group completed successfully.
Nov 05 18:41:54 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d275d47f-0077-44da-8b80-80bb248ef84d tempest-GroupSnapshotsTest-46186209 None] Update group completed successfully.
Nov 05 18:41:55 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-caaaf743-4a61-4269-bf47-e92bcd8b1233 tempest-GroupSnapshotsTest-46186209 None] Update group completed successfully.
Nov 05 18:41:55 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:41:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Flow 'volume_create_manager' (4f8ee4e1-122d-455c-9f49-f3e84dccdd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:41:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc3919c-50ca-492a-8141-9dc2d692a9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc3919c-50ca-492a-8141-9dc2d692a9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1353624221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872ff913-d43f-49e4-a490-6f430a706331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feed5b86a773422b830640cd4df6eeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:56Z,use_quota=True,user_id='c5a5130b8c03413487401f53f753f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7783e8ec-f79b-4fb5-b971-4f1951bd7266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7783e8ec-f79b-4fb5-b971-4f1951bd7266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc1aa04-c8b1-4426-a656-fe1481275abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:55 devstack cinder-volume[87086]: DEBUG cinder.image.glance [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Creating Keystone auth plugin from conf {{(pid=87086) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 18:41:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc1aa04-c8b1-4426-a656-fe1481275abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '872ff913-d43f-49e4-a490-6f430a706331', 'volume_name': 'volume-872ff913-d43f-49e4-a490-6f430a706331', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea4ebe30>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d553b07e-7229-4047-a287-125a9f2d368b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d553b07e-7229-4047-a287-125a9f2d368b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:41:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c199fb-1377-4378-913e-ce80399c8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:41:56 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Volume 872ff913-d43f-49e4-a490-6f430a706331: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-872ff913-d43f-49e4-a490-6f430a706331', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea4ebe30>}
Nov 05 18:41:56 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Trying to clone 872ff913-d43f-49e4-a490-6f430a706331 from image f12bcbef-da90-40ac-bcfe-4218bc9aa565 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]). {{(pid=87086) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 18:41:56 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 18:41:56 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 18:41:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8f59311d-465e-499a-b486-ecc39c6c784e tempest-GroupSnapshotsTest-46186209 None] Update group completed successfully.
Nov 05 18:41:56 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e411e2-4710-4233-80d0-22c31a4c3032]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:56 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD
Nov 05 18:41:56 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:57 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Temporary image f12bcbef-da90-40ac-bcfe-4218bc9aa565 is fetched for user c5a5130b8c03413487401f53f753f56d. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d988a037-2cfa-4f3d-9248-c967f5bc099b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:57 devstack sudo[97836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD
Nov 05 18:41:57 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:57 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1353624221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872ff913-d43f-49e4-a490-6f430a706331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feed5b86a773422b830640cd4df6eeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:41:56Z,use_quota=True,user_id='c5a5130b8c03413487401f53f753f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Creating volume 872ff913-d43f-49e4-a490-6f430a706331 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:41:57 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:57 devstack sudo[97841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 1073741824
Nov 05 18:41:57 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:57 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 1073741824" returned: 0 in 0.500s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:58 devstack sudo[97847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331
Nov 05 18:41:58 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:58 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] GroupSnapshot 35ff523b-e964-4748-aa54-63a6ffa52f43: creating.
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Group snapshot 35ff523b-e964-4748-aa54-63a6ffa52f43: creating. {{(pid=87086) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:41:58 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331" returned: 0 in 0.290s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.177s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Creating offline snapshot 7251b318-f45f-4a00-b616-4c778aee3ade of volume 4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Attempting download of f12bcbef-da90-40ac-bcfe-4218bc9aa565 ((None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}])) to volume 872ff913-d43f-49e4-a490-6f430a706331. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1fa9e8-b5c7-407d-9be9-54829ef67142]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fde69a-924b-42d9-bb1e-196c544c98fb]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_wwcahhgd {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:58 devstack sudo[97850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a
Nov 05 18:41:58 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:58 devstack sudo[97851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_wwcahhgd
Nov 05 18:41:58 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:58 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_wwcahhgd" returned: 0 in 0.380s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_wwcahhgd {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:58 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" returned: 0 in 0.473s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:58 devstack sudo[97860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade 1G
Nov 05 18:41:58 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:58 devstack sudo[97859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_wwcahhgd
Nov 05 18:41:58 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:59 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_wwcahhgd" returned: 1 in 0.368s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_wwcahhgd' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3fc61c-2500-4e4a-83d3-0530934296fb]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:59 devstack sudo[97868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD
Nov 05 18:41:59 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:59 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade 1G" returned: 0 in 0.608s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:59 devstack sudo[97870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade
Nov 05 18:41:59 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:59 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] f12bcbef-da90-40ac-bcfe-4218bc9aa565 was qcow2, converting to qcow2 {{(pid=87086) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:59 devstack sudo[97876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331
Nov 05 18:41:59 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:41:59 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade" returned: 0 in 0.446s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:41:59 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:41:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:41:59 devstack sudo[97882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade
Nov 05 18:41:59 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:00 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade" returned: 0 in 0.300s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:00 devstack sudo[97891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.info
Nov 05 18:42:00 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:00 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.info" returned: 0 in 0.309s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:00 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:42:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:00 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.info
Nov 05 18:42:00 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:01 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.info" returned: 0 in 0.408s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.783s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Creating offline snapshot 923a2aaa-e1e4-4615-bb07-05b43a3e107e of volume 77c5c68d-c95e-4545-8ebf-2a8c55af5796 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:42:01 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1e51a3-5169-4cf9-b966-7cbab0f4f11f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:01 devstack sudo[97897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796
Nov 05 18:42:01 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:01 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796" returned: 0 in 0.496s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:01 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e 1G
Nov 05 18:42:01 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:02 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331" returned: 0 in 2.451s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565__lxj55hrdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:42:02 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Converted 112.00 MB image at 45.66 MB/s
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:02 devstack sudo[97907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 1G
Nov 05 18:42:02 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:02 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e 1G" returned: 0 in 0.613s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:02 devstack sudo[97910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e
Nov 05 18:42:02 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:02 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 1G" returned: 0 in 0.457s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Downloaded image f12bcbef-da90-40ac-bcfe-4218bc9aa565 ((None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}])) to volume 872ff913-d43f-49e4-a490-6f430a706331 successfully. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Temporary image f12bcbef-da90-40ac-bcfe-4218bc9aa565 for user c5a5130b8c03413487401f53f753f56d is deleted. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Marking volume 872ff913-d43f-49e4-a490-6f430a706331 as bootable. {{(pid=87086) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Copying metadata from image f12bcbef-da90-40ac-bcfe-4218bc9aa565 to 872ff913-d43f-49e4-a490-6f430a706331. {{(pid=87086) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Creating volume glance metadata for volume 872ff913-d43f-49e4-a490-6f430a706331 backed by image f12bcbef-da90-40ac-bcfe-4218bc9aa565 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87086) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 18:42:02 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e" returned: 0 in 0.403s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:02 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:02 devstack sudo[97922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e
Nov 05 18:42:02 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c199fb-1377-4378-913e-ce80399c8566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872ff913-d43f-49e4-a490-6f430a706331', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea4ebe30>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7ef9f9-2a1f-45d2-b75c-5a76d98da15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Volume volume-872ff913-d43f-49e4-a490-6f430a706331 (872ff913-d43f-49e4-a490-6f430a706331): created successfully
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7ef9f9-2a1f-45d2-b75c-5a76d98da15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Flow 'volume_create_manager' (4f8ee4e1-122d-455c-9f49-f3e84dccdd76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:02 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8655a327-5d52-45a4-a02a-23fa7cbf1a5a tempest-VolumesExtendTest-2069320539 None] Created volume successfully.
Nov 05 18:42:03 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e" returned: 0 in 0.402s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:03 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.info
Nov 05 18:42:03 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Flow 'volume_create_manager' (08f04991-9c02-4f3f-8af8-256db76a0651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffd2e1a-3a0c-4722-a91e-4ec290d2b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffd2e1a-3a0c-4722-a91e-4ec290d2b948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1697405559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10931a3c-d2ba-49bf-884a-53653f2eea0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d14916e24a44851bd1a9d286fa881b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:03Z,use_quota=True,user_id='24caf190e11b4ca396dc62f2496dd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d3bcbb-2f2e-42c9-b66c-0c8ca12a0b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d3bcbb-2f2e-42c9-b66c-0c8ca12a0b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa7f92d-c000-4a7e-b20c-9c0e5106859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa7f92d-c000-4a7e-b20c-9c0e5106859f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10931a3c-d2ba-49bf-884a-53653f2eea0a', 'volume_name': 'volume-10931a3c-d2ba-49bf-884a-53653f2eea0a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9946ca6b-c740-40ba-8eeb-7ad8c00eb97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9946ca6b-c740-40ba-8eeb-7ad8c00eb97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1f0b5a-89da-455c-8621-f6875b2a105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:03 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Volume 10931a3c-d2ba-49bf-884a-53653f2eea0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10931a3c-d2ba-49bf-884a-53653f2eea0a', 'volume_size': 1}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:03 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.info" returned: 0 in 0.291s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:03 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:03 devstack sudo[97928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.info
Nov 05 18:42:03 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-54ac47d0-0190-4246-8d8d-e449d47f72c6 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:03 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.info" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1697405559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10931a3c-d2ba-49bf-884a-53653f2eea0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d14916e24a44851bd1a9d286fa881b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:03Z,use_quota=True,user_id='24caf190e11b4ca396dc62f2496dd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Creating volume 10931a3c-d2ba-49bf-884a-53653f2eea0a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:42:03 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:42:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:03 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a 1073741824
Nov 05 18:42:03 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:03 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7d8e9033-df49-4d5a-a3fe-7f755f333e5e tempest-GroupSnapshotsTest-46186209 None] group_snapshot 35ff523b-e964-4748-aa54-63a6ffa52f43: created successfully
Nov 05 18:42:04 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a 1073741824" returned: 0 in 0.492s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:04 devstack sudo[97937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a
Nov 05 18:42:04 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:04 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-54ac47d0-0190-4246-8d8d-e449d47f72c6 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.089s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1f0b5a-89da-455c-8621-f6875b2a105d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10931a3c-d2ba-49bf-884a-53653f2eea0a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf9a377-f6b4-4d87-8895-66c6dc6a137b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:04 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Volume volume-10931a3c-d2ba-49bf-884a-53653f2eea0a (10931a3c-d2ba-49bf-884a-53653f2eea0a): created successfully
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf9a377-f6b4-4d87-8895-66c6dc6a137b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Flow 'volume_create_manager' (08f04991-9c02-4f3f-8af8-256db76a0651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3f670a-455a-4f2b-bd94-6d469d3a266c]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-54ac47d0-0190-4246-8d8d-e449d47f72c6 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3663be7a-a1cf-46bf-bdc3-e5cf87bbea93 tempest-AttachVolumeNegativeTest-1126432362 None] Created volume successfully.
Nov 05 18:42:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] group_snapshot 35ff523b-e964-4748-aa54-63a6ffa52f43: deleting
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] group_snapshot 35ff523b-e964-4748-aa54-63a6ffa52f43: deleting {{(pid=87086) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 18:42:04 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331
Nov 05 18:42:04 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-7251b318-f45f-4a00-b616-4c778aee3ade" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-7251b318-f45f-4a00-b616-4c778aee3ade" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Deleting offline snapshot 7251b318-f45f-4a00-b616-4c778aee3ade of volume 4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] snapshot_file for this snap is: volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[230d396e-a547-4a15-97c1-70c9846c9299]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:05 devstack sudo[97942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade
Nov 05 18:42:05 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:05 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-54ac47d0-0190-4246-8d8d-e449d47f72c6 tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331" returned: 0 in 0.586s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-54ac47d0-0190-4246-8d8d-e449d47f72c6 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 2G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-54ac47d0-0190-4246-8d8d-e449d47f72c6 tempest-VolumesExtendTest-2069320539 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 2G" returned: 0 in 0.154s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-54ac47d0-0190-4246-8d8d-e449d47f72c6 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.857s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:05 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade" returned: 0 in 0.558s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:05 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-54ac47d0-0190-4246-8d8d-e449d47f72c6 tempest-VolumesExtendTest-2069320539 None] Extend volume completed successfully.
Nov 05 18:42:05 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[34443491-3bea-4ac5-8400-92981ae400ed]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:05 devstack sudo[97958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a
Nov 05 18:42:05 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:06 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" returned: 0 in 0.601s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:06 devstack sudo[97970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade
Nov 05 18:42:06 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-f0a26a21-d020-4d49-9ee2-cc53dec9ec23 req-7becd13f-86e7-4f08-8226-dd7f013fb95c tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-f0a26a21-d020-4d49-9ee2-cc53dec9ec23 req-7becd13f-86e7-4f08-8226-dd7f013fb95c tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-f0a26a21-d020-4d49-9ee2-cc53dec9ec23 req-7becd13f-86e7-4f08-8226-dd7f013fb95c tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-f0a26a21-d020-4d49-9ee2-cc53dec9ec23 req-7becd13f-86e7-4f08-8226-dd7f013fb95c tempest-AttachVolumeNegativeTest-1126432362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-10931a3c-d2ba-49bf-884a-53653f2eea0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de3e1e51-6f54-4308-93b6-91d9ed942d70', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "cinder-872ff913-d43f-49e4-a490-6f430a706331-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-872ff913-d43f-49e4-a490-6f430a706331-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:06 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-f0a26a21-d020-4d49-9ee2-cc53dec9ec23 req-7becd13f-86e7-4f08-8226-dd7f013fb95c tempest-AttachVolumeNegativeTest-1126432362 None] attachment_update completed successfully.
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "cinder-quobyte-872ff913-d43f-49e4-a490-6f430a706331" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-quobyte-872ff913-d43f-49e4-a490-6f430a706331" acquired by "delete_volume" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[588a8732-dd5a-4cbd-9c40-4f1449930d70]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:06 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade" returned: 0 in 0.512s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:06 devstack sudo[97980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade
Nov 05 18:42:06 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:06 devstack sudo[97979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331
Nov 05 18:42:06 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:07 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a.7251b318-f45f-4a00-b616-4c778aee3ade" returned: 0 in 0.405s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-7251b318-f45f-4a00-b616-4c778aee3ade" released by "_delete_snapshot" :: held 2.282s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" released by "delete_snapshot" :: held 2.333s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-77c5c68d-c95e-4545-8ebf-2a8c55af5796" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-77c5c68d-c95e-4545-8ebf-2a8c55af5796" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-923a2aaa-e1e4-4615-bb07-05b43a3e107e" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-923a2aaa-e1e4-4615-bb07-05b43a3e107e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Deleting offline snapshot 923a2aaa-e1e4-4615-bb07-05b43a3e107e of volume 77c5c68d-c95e-4545-8ebf-2a8c55af5796 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] snapshot_file for this snap is: volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:42:07 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331" returned: 0 in 0.665s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4404c351-146b-4a10-ac80-a4b249ff98cb]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:07 devstack sudo[98401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331
Nov 05 18:42:07 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:07 devstack sudo[98402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e
Nov 05 18:42:07 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:07 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-872ff913-d43f-49e4-a490-6f430a706331" returned: 0 in 0.358s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-quobyte-872ff913-d43f-49e4-a490-6f430a706331" released by "delete_volume" :: held 1.097s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Created reservations ['ac97831b-ce1e-4d06-886a-cb4b4cc5ec2d', '6d08d95f-b7ae-4e18-83f4-255241546590', '5925cac3-2235-4a32-9d8b-925c8d11965c', 'f30dc28e-bcdb-4fe1-9d5e-6fb58d756826'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:07 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e" returned: 0 in 0.525s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f904ab87-5526-4997-aa82-b028384ba1ab]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:07 devstack sudo[98410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:42:07 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:08 devstack sudo[98409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796
Nov 05 18:42:08 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:08 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.398s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:08 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:42:08 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Deleted volume successfully.
Nov 05 18:42:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ee7c8a1f-a719-4d8f-99b0-df0a7e552300 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-872ff913-d43f-49e4-a490-6f430a706331-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:08 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796" returned: 0 in 0.541s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:08 devstack sudo[98417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e
Nov 05 18:42:08 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:08 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e" returned: 0 in 0.486s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:08 devstack sudo[98423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e
Nov 05 18:42:08 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:09 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-250d29e5-757e-4815-8579-02fa3ed6f6ee req-49d2e5fc-1255-47f9-a4f4-3f130ccf1e0a tempest-AttachVolumeNegativeTest-1126432362 None] Terminate volume connection completed successfully.
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-250d29e5-757e-4815-8579-02fa3ed6f6ee req-49d2e5fc-1255-47f9-a4f4-3f130ccf1e0a tempest-AttachVolumeNegativeTest-1126432362 None] Deleting attachment de3e1e51-6f54-4308-93b6-91d9ed942d70. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:42:09 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796.923a2aaa-e1e4-4615-bb07-05b43a3e107e" returned: 0 in 0.380s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-923a2aaa-e1e4-4615-bb07-05b43a3e107e" released by "_delete_snapshot" :: held 2.116s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-77c5c68d-c95e-4545-8ebf-2a8c55af5796" released by "delete_snapshot" :: held 2.144s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Flow 'volume_create_manager' (810923a3-c1e2-4928-9e70-c9281d031b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b311d6b-83a4-4f0b-a70a-8b1a5ada0737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b311d6b-83a4-4f0b-a70a-8b1a5ada0737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-351012713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e7a696-4d6f-4455-b977-41cc7d1e9b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feed5b86a773422b830640cd4df6eeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:09Z,use_quota=True,user_id='c5a5130b8c03413487401f53f753f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20ed3a1-7281-4451-88cb-607213ee84c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20ed3a1-7281-4451-88cb-607213ee84c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70638f3-c51a-45ac-9432-a7c4b1689a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70638f3-c51a-45ac-9432-a7c4b1689a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e7a696-4d6f-4455-b977-41cc7d1e9b4d', 'volume_name': 'volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d70188-1f61-4272-8c1f-33fc11daefac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d70188-1f61-4272-8c1f-33fc11daefac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57bdd23-e94a-4cd8-98ff-68033d4e2c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:09 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Volume 54e7a696-4d6f-4455-b977-41cc7d1e9b4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d', 'volume_size': 1}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-351012713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e7a696-4d6f-4455-b977-41cc7d1e9b4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feed5b86a773422b830640cd4df6eeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:09Z,use_quota=True,user_id='c5a5130b8c03413487401f53f753f56d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Creating volume 54e7a696-4d6f-4455-b977-41cc7d1e9b4d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:42:09 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:09 devstack sudo[98452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d 1073741824
Nov 05 18:42:09 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:09 devstack cinder-volume[87086]: WARNING cinder.quota [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-912386935 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-912386935, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:42:09 devstack cinder-volume[87086]: WARNING cinder.quota [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-912386935 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-912386935, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Created reservations ['406288eb-c198-42bf-9a48-4fc2bb93ee95', '5c735426-760d-410d-9f34-e4d4aa903728', 'dae14c9e-250c-4b01-9b7f-618a1801aadb', '76e1f358-ce07-47d6-bdb6-f469e55181f8'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:09 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] Created reservations ['b99729d7-2429-4c99-bd19-89f63f6001be', '7ecc518c-5ab9-430c-97de-4d7cf5eab534', 'f52e51b4-11fd-4ca2-bbe6-5684bae7293a', 'f91329c5-243e-4fe6-a834-78c98c84c044'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:09 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8b95e136-d9ce-4a47-9156-604b27660921 tempest-GroupSnapshotsTest-46186209 None] group_snapshot 35ff523b-e964-4748-aa54-63a6ffa52f43: deleted successfully
Nov 05 18:42:10 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d 1073741824" returned: 0 in 0.689s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:10 devstack sudo[98458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d
Nov 05 18:42:10 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:10 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" returned: 0 in 0.580s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:42:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57bdd23-e94a-4cd8-98ff-68033d4e2c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8a6693-3de3-473b-888e-7c2566eda43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:10 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Volume volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d (54e7a696-4d6f-4455-b977-41cc7d1e9b4d): created successfully
Nov 05 18:42:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8a6693-3de3-473b-888e-7c2566eda43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Flow 'volume_create_manager' (810923a3-c1e2-4928-9e70-c9281d031b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:11 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-34fd58f5-9ab9-4dc2-afac-3bcb91891a76 tempest-VolumesExtendTest-2069320539 None] Created volume successfully.
Nov 05 18:42:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" acquired by "delete_volume" :: waited 0.029s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:11 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[566eec89-2a58-4e50-8332-95d204a5a66b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:11 devstack sudo[98482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a
Nov 05 18:42:11 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:11 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" returned: 0 in 0.573s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:12 devstack sudo[98488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a
Nov 05 18:42:12 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Creating offline snapshot 90bc20fd-90fc-40c3-889d-57988c422df7 of volume 54e7a696-4d6f-4455-b977-41cc7d1e9b4d {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b323d7aa-7bc3-44ae-9da7-e9b5e4a02e6f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:12 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" returned: 0 in 0.359s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-4d63dc7b-fbc5-4205-ac2e-f2c4d872c95a" released by "delete_volume" :: held 1.032s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-77c5c68d-c95e-4545-8ebf-2a8c55af5796" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-77c5c68d-c95e-4545-8ebf-2a8c55af5796" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:12 devstack sudo[98490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d
Nov 05 18:42:12 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[27992ca3-68fb-4029-8ad6-4e908a310896]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:12 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796
Nov 05 18:42:12 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:12 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" returned: 0 in 0.494s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:12 devstack sudo[98500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 1G
Nov 05 18:42:12 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:12 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796" returned: 0 in 0.482s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:12 devstack sudo[98505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796
Nov 05 18:42:12 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:13 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-77c5c68d-c95e-4545-8ebf-2a8c55af5796" returned: 0 in 0.320s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-77c5c68d-c95e-4545-8ebf-2a8c55af5796" released by "delete_volume" :: held 0.889s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:13 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 1G" returned: 0 in 0.548s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:13 devstack sudo[98512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7
Nov 05 18:42:13 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Created reservations ['fa02ef6e-ac9e-4591-b17d-509aa81f0431'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:13 devstack cinder-volume[87086]: WARNING cinder.quota [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-912386935 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-912386935, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Created reservations ['8ec34995-9c7a-46b1-a05e-95973fe2ba2c', 'c82b98d2-2995-4c02-99c2-34bbbdf5d16d', '429c5cd6-bd1b-4c54-adb6-d4a17cbdb58d', '159cbe55-1fe8-4f95-bdda-1ab7f6003b48'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Created reservations ['b3440793-e024-44c7-b618-479bc621597b', '5afa3e0c-1077-44ef-9850-63e32b0f51cc', '7b3871a4-9fc4-4f88-9b2e-d9ed582b5de2', 'e6774ffd-1f80-4d9b-93d7-e60fedbfb3f7'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:13 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7" returned: 0 in 0.554s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:13 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 is being set with open permissions: ugo+rw
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:13 devstack sudo[98518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7
Nov 05 18:42:13 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:13 devstack sudo[98519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:42:13 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:14 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.308s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:14 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:42:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1128109e-4457-49c0-a80a-44182d62f5c9 tempest-GroupSnapshotsTest-46186209 None] Delete group completed successfully.
Nov 05 18:42:14 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7" returned: 0 in 0.389s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:14 devstack sudo[98524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.info
Nov 05 18:42:14 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:14 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.info" returned: 0 in 0.275s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:14 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.info is being set with open permissions: ugo+rw
Nov 05 18:42:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:14 devstack sudo[98527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.info
Nov 05 18:42:14 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:14 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.info" returned: 0 in 0.259s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.672s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b42c451f-e518-4f80-8753-b0b26efb3e38 tempest-VolumesExtendTest-2069320539 None] Create snapshot completed successfully
Nov 05 18:42:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d846c8a2-dad8-4437-94e8-339327b58d66 tempest-GroupSnapshotsTest-46186209 None] Group tempest-GroupSnapshotsTest-Group-953223304: creating
Nov 05 18:42:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c5e53958-43cd-438d-bcb9-1926ca4b0fc5 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c5e53958-43cd-438d-bcb9-1926ca4b0fc5 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:15 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e85159d-b36d-4222-bfd5-c274a5c74975]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c5e53958-43cd-438d-bcb9-1926ca4b0fc5 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d846c8a2-dad8-4437-94e8-339327b58d66 tempest-GroupSnapshotsTest-46186209 None] Group tempest-GroupSnapshotsTest-Group-953223304: created successfully
Nov 05 18:42:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d846c8a2-dad8-4437-94e8-339327b58d66 tempest-GroupSnapshotsTest-46186209 None] Create group completed successfully.
Nov 05 18:42:15 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d
Nov 05 18:42:15 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "cinder-10931a3c-d2ba-49bf-884a-53653f2eea0a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-10931a3c-d2ba-49bf-884a-53653f2eea0a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "cinder-quobyte-10931a3c-d2ba-49bf-884a-53653f2eea0a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-quobyte-10931a3c-d2ba-49bf-884a-53653f2eea0a" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:15 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8452eea9-77ea-44e1-a722-93c6f0cf4866]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:15 devstack sudo[98534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a
Nov 05 18:42:15 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:16 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c5e53958-43cd-438d-bcb9-1926ca4b0fc5 tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c5e53958-43cd-438d-bcb9-1926ca4b0fc5 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 2G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c5e53958-43cd-438d-bcb9-1926ca4b0fc5 tempest-VolumesExtendTest-2069320539 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 2G" returned: 0 in 0.127s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c5e53958-43cd-438d-bcb9-1926ca4b0fc5 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.607s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:16 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c5e53958-43cd-438d-bcb9-1926ca4b0fc5 tempest-VolumesExtendTest-2069320539 None] Extend volume completed successfully.
Nov 05 18:42:16 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a" returned: 0 in 0.403s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:16 devstack sudo[98545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a
Nov 05 18:42:16 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:16 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-10931a3c-d2ba-49bf-884a-53653f2eea0a" returned: 0 in 0.263s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-quobyte-10931a3c-d2ba-49bf-884a-53653f2eea0a" released by "delete_volume" :: held 0.728s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Created reservations ['223599ef-a03e-45d7-b6b9-94b8ab6b84ee', '0259e16a-c0e4-4d99-9eac-39e2612e7208', 'f8092d75-06a8-49fc-b403-e8189218aef7', 'b5d25aa7-e88b-4226-8769-67ad2c3611d7'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "cinder-90bc20fd-90fc-40c3-889d-57988c422df7-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-90bc20fd-90fc-40c3-889d-57988c422df7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "cinder-quobyte-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:16 devstack sudo[98548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:42:16 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-quobyte-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "cinder-quobyte-90bc20fd-90fc-40c3-889d-57988c422df7" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-quobyte-90bc20fd-90fc-40c3-889d-57988c422df7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Deleting offline snapshot 90bc20fd-90fc-40c3-889d-57988c422df7 of volume 54e7a696-4d6f-4455-b977-41cc7d1e9b4d {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] snapshot_file for this snap is: volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e11a3d7-3108-40ed-a38a-8082cc05acbb]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:17 devstack sudo[98550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7
Nov 05 18:42:17 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "cinder-79173d1e-aa1f-4404-b597-edccea1884be-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-79173d1e-aa1f-4404-b597-edccea1884be-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "cinder-quobyte-79173d1e-aa1f-4404-b597-edccea1884be" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-quobyte-79173d1e-aa1f-4404-b597-edccea1884be" acquired by "delete_volume" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:17 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.534s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:42:17 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Deleted volume successfully.
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6632e5a-8c88-4197-a204-42951aaee5af]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3e7b821d-828f-4027-b6c0-be53110cad40 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-10931a3c-d2ba-49bf-884a-53653f2eea0a-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:17 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7" returned: 0 in 0.550s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:17 devstack sudo[98555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be
Nov 05 18:42:17 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee67be7b-bcc3-45cc-aec3-10b580dc2413]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Flow 'volume_create_manager' (213ad43c-5432-4824-8425-b30f64671232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb92498-3fe5-4a40-81cb-71432b997202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb92498-3fe5-4a40-81cb-71432b997202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2132870329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03ac8232-6a0f-4c0e-8860-b0b41875b752,host='devstack@QuobyteHD#QuobyteHD',id=0c4bc113-ee00-4cda-8a8a-e968c4aca696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e226df52b3394276a78fb1edb638e722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:17Z,use_quota=True,user_id='8ad77bc416b34ac1bd19d75590cf443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ff63d7-8b40-46f9-953e-4e7c8e07a8f8),volume_type_id=11ff63d7-8b40-46f9-953e-4e7c8e07a8f8)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d12d7df-e7b3-4b39-b251-1fcb514a5bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d12d7df-e7b3-4b39-b251-1fcb514a5bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29fc8fad-5cd6-45ba-b124-387f0678beb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29fc8fad-5cd6-45ba-b124-387f0678beb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4bc113-ee00-4cda-8a8a-e968c4aca696', 'volume_name': 'volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482461a5-1d50-4627-a055-8079983c83e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (482461a5-1d50-4627-a055-8079983c83e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fc0c50-3457-4e86-bbe0-cf80b11209ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:17 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Volume 0c4bc113-ee00-4cda-8a8a-e968c4aca696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696', 'volume_size': 1}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=03ac8232-6a0f-4c0e-8860-b0b41875b752,created_at=2026-11-05T17:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2132870329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03ac8232-6a0f-4c0e-8860-b0b41875b752,host='devstack@QuobyteHD#QuobyteHD',id=0c4bc113-ee00-4cda-8a8a-e968c4aca696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e226df52b3394276a78fb1edb638e722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:17Z,use_quota=True,user_id='8ad77bc416b34ac1bd19d75590cf443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ff63d7-8b40-46f9-953e-4e7c8e07a8f8),volume_type_id=11ff63d7-8b40-46f9-953e-4e7c8e07a8f8)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Creating volume 0c4bc113-ee00-4cda-8a8a-e968c4aca696 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:42:17 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:17 devstack sudo[98558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d
Nov 05 18:42:17 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:17 devstack sudo[98560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 1073741824
Nov 05 18:42:17 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:17 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be" returned: 0 in 0.477s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:17 devstack sudo[98565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be
Nov 05 18:42:17 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:18 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" returned: 0 in 0.516s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:18 devstack sudo[98573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7
Nov 05 18:42:18 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:18 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79173d1e-aa1f-4404-b597-edccea1884be" returned: 0 in 0.351s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-quobyte-79173d1e-aa1f-4404-b597-edccea1884be" released by "delete_volume" :: held 0.935s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:18 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Created reservations ['bc2f2ef6-fc3b-4aa8-8a4c-5c5c37c366e4', '92a3bfd7-94e3-4b7c-b291-28c8fe8c5950', 'c3f3a20f-f429-489c-bcea-720d61597731', 'bfed92fb-7198-4ae3-887f-ea40cf891683'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 1073741824" returned: 0 in 0.540s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:18 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696
Nov 05 18:42:18 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:18 devstack sudo[98582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:42:18 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:18 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7" returned: 0 in 0.499s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:18 devstack sudo[98584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7
Nov 05 18:42:18 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:18 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:18 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696" returned: 0 in 0.414s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.357s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "cinder-65405479-3ae2-42d1-bb51-4831614f84dc-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:18 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Deleted volume successfully.
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fc0c50-3457-4e86-bbe0-cf80b11209ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a39f8c-6687-4725-93ea-6a551b297d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-65405479-3ae2-42d1-bb51-4831614f84dc-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-619c65ac-5eca-4578-a6f9-0f272618deb1 tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-79173d1e-aa1f-4404-b597-edccea1884be-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:18 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Volume volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 (0c4bc113-ee00-4cda-8a8a-e968c4aca696): created successfully
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a39f8c-6687-4725-93ea-6a551b297d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Flow 'volume_create_manager' (213ad43c-5432-4824-8425-b30f64671232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "cinder-quobyte-65405479-3ae2-42d1-bb51-4831614f84dc" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:18 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-95d1e58d-b1dd-4d51-b7b6-fb68726799f5 tempest-GroupSnapshotsTest-46186209 None] Created volume successfully.
Nov 05 18:42:18 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-quobyte-65405479-3ae2-42d1-bb51-4831614f84dc" acquired by "delete_volume" :: waited 0.038s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d.90bc20fd-90fc-40c3-889d-57988c422df7" returned: 0 in 0.445s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28f1813-c151-4194-8283-8594d1ac6324]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-quobyte-90bc20fd-90fc-40c3-889d-57988c422df7" released by "_delete_snapshot" :: held 2.218s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-quobyte-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" released by "delete_snapshot" :: held 2.261s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Created reservations ['80290987-fc93-40a2-abe8-8b1d6fa7cc9b', 'c2846c73-dd95-41d4-801c-1859711b4d43', '19376712-5a15-4e76-9ef3-50587fb8505c', 'c995132d-c76f-4993-a21e-ec2e87bd7020'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:19 devstack sudo[98589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc
Nov 05 18:42:19 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:19 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Delete snapshot completed successfully.
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c4a931f4-8261-4107-a122-41355e032e05 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-90bc20fd-90fc-40c3-889d-57988c422df7-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:19 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc" returned: 0 in 0.421s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:19 devstack sudo[98595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc
Nov 05 18:42:19 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:19 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-65405479-3ae2-42d1-bb51-4831614f84dc" returned: 0 in 0.265s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-quobyte-65405479-3ae2-42d1-bb51-4831614f84dc" released by "delete_volume" :: held 0.794s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Created reservations ['2275e2a1-6193-4202-9617-ed02f3ba3f6d', '1cd1e427-df28-4cbd-8629-765c27c82e76', '1ea353b8-7f1d-43e6-8a65-19e77935a549', '3b7fe85e-944d-470a-96f2-d48d4978a840'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:19 devstack sudo[98598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:42:19 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "cinder-54e7a696-4d6f-4455-b977-41cc7d1e9b4d-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-54e7a696-4d6f-4455-b977-41cc7d1e9b4d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "cinder-quobyte-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-quobyte-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" acquired by "delete_volume" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:20 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] GroupSnapshot dfc0a15c-a602-473d-84ca-2d6ac61b3133: creating.
Nov 05 18:42:20 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.549s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39d8a24-ae80-454e-8e54-4d3500974ef3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:20 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Deleted volume successfully.
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Group snapshot dfc0a15c-a602-473d-84ca-2d6ac61b3133: creating. {{(pid=87086) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-131d7cbd-8b14-49b1-988d-baaacad7833b tempest-AttachVolumeNegativeTest-1126432362 None] Lock "cinder-65405479-3ae2-42d1-bb51-4831614f84dc-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Creating offline snapshot c8071914-0ce2-4ca4-b071-4a8f02a5a574 of volume 0c4bc113-ee00-4cda-8a8a-e968c4aca696 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[28adfd01-8108-4680-bcb7-95a9605344ac]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:20 devstack sudo[98601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d
Nov 05 18:42:20 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:20 devstack sudo[98602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696
Nov 05 18:42:20 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:20 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" returned: 0 in 0.463s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:20 devstack sudo[98612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d
Nov 05 18:42:20 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:20 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696" returned: 0 in 0.422s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:21 devstack sudo[98614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574 1G
Nov 05 18:42:21 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:21 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" returned: 0 in 0.280s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-quobyte-54e7a696-4d6f-4455-b977-41cc7d1e9b4d" released by "delete_volume" :: held 0.865s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Created reservations ['1ca95788-cef8-4d15-bad7-4bc8779945d0', 'a52b6078-ec09-47d2-b9be-f28a5960edb3', 'b9021cad-15f7-442f-93aa-50d9477e582b', '7842ec34-0f3a-48f8-8a37-4136bda29cb8'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:21 devstack sudo[98620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:42:21 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:21 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574 1G" returned: 0 in 0.584s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:21 devstack sudo[98623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574
Nov 05 18:42:21 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:21 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:42:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Deleted volume successfully.
Nov 05 18:42:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb2bbacc-b07a-43ea-b979-e34eaa116291 tempest-VolumesExtendTest-2069320539 None] Lock "cinder-54e7a696-4d6f-4455-b977-41cc7d1e9b4d-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:22 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574" returned: 0 in 0.527s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:22 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:42:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:22 devstack sudo[98630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574
Nov 05 18:42:22 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:22 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574" returned: 0 in 0.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:22 devstack sudo[98633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.info
Nov 05 18:42:22 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:22 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.info" returned: 0 in 0.288s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:22 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:42:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:22 devstack sudo[98636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.info
Nov 05 18:42:22 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:23 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.info" returned: 0 in 0.325s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9882df0a-7215-4a7b-8154-4f3d6ca2c1a6 tempest-GroupSnapshotsTest-46186209 None] group_snapshot dfc0a15c-a602-473d-84ca-2d6ac61b3133: created successfully
Nov 05 18:42:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] group_snapshot dfc0a15c-a602-473d-84ca-2d6ac61b3133: deleting
Nov 05 18:42:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] group_snapshot dfc0a15c-a602-473d-84ca-2d6ac61b3133: deleting {{(pid=87086) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-0c4bc113-ee00-4cda-8a8a-e968c4aca696" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-0c4bc113-ee00-4cda-8a8a-e968c4aca696" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-c8071914-0ce2-4ca4-b071-4a8f02a5a574" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-c8071914-0ce2-4ca4-b071-4a8f02a5a574" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Deleting offline snapshot c8071914-0ce2-4ca4-b071-4a8f02a5a574 of volume 0c4bc113-ee00-4cda-8a8a-e968c4aca696 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] snapshot_file for this snap is: volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efdd912-c825-463d-9c7f-c67ee8a4518f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:24 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574
Nov 05 18:42:24 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:24 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574" returned: 0 in 0.484s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a906df8d-9797-48d9-84ef-7aae8bd66c7d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:24 devstack sudo[98645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696
Nov 05 18:42:24 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:25 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696" returned: 0 in 0.592s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:25 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574
Nov 05 18:42:25 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:25 devstack sudo[98654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:42:25 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:25 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574" returned: 0 in 0.574s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:25 devstack sudo[98659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574
Nov 05 18:42:25 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:26 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.410s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:42:26 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:42:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:42:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:42:26 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696.c8071914-0ce2-4ca4-b071-4a8f02a5a574" returned: 0 in 0.405s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-c8071914-0ce2-4ca4-b071-4a8f02a5a574" released by "_delete_snapshot" :: held 2.250s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-0c4bc113-ee00-4cda-8a8a-e968c4aca696" released by "delete_snapshot" :: held 2.296s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:26 devstack cinder-volume[87086]: WARNING cinder.quota [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1661121137 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1661121137, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:42:26 devstack cinder-volume[87086]: WARNING cinder.quota [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1661121137 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1661121137, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:42:26 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] Created reservations ['2d33cd38-04f0-450d-863f-0a58d6ffa4ba', '4bf1e025-1b48-4de7-9b58-ee8d0fb9dba2', '3114b90c-6fa4-41e6-9d86-a813d2635896', 'd44e09c2-3a7f-4fb5-8ae5-22df2403d13e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a265ab52-fa00-4477-9c2a-03217ccb3223 tempest-GroupSnapshotsTest-46186209 None] group_snapshot dfc0a15c-a602-473d-84ca-2d6ac61b3133: deleted successfully
Nov 05 18:42:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "cinder-quobyte-0c4bc113-ee00-4cda-8a8a-e968c4aca696" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-0c4bc113-ee00-4cda-8a8a-e968c4aca696" acquired by "delete_volume" :: waited 0.039s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:27 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f52673-66ee-48ad-8113-a8d32f906f51]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Flow 'volume_create_manager' (e81f3306-c83d-40a6-ac20-3591486dfd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c966ab09-2ca9-4c4b-abfb-bc72b8321ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c966ab09-2ca9-4c4b-abfb-bc72b8321ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-486553519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304e54fb-38d3-457e-8f5d-172fe08d7d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942b57c91a4441eb196399f59d59d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:28Z,use_quota=True,user_id='58a9e48ea4024557a94a78ba660b6913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb376de9-631e-4149-8aab-a0250e27fd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb376de9-631e-4149-8aab-a0250e27fd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40762a1b-1ab9-4e47-b3e3-18968b1e388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40762a1b-1ab9-4e47-b3e3-18968b1e388a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '304e54fb-38d3-457e-8f5d-172fe08d7d30', 'volume_name': 'volume-304e54fb-38d3-457e-8f5d-172fe08d7d30', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08236825-ebdf-428b-894f-231d10092065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08236825-ebdf-428b-894f-231d10092065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8476e4-b71a-43de-8970-982394acbba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:28 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Volume 304e54fb-38d3-457e-8f5d-172fe08d7d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-304e54fb-38d3-457e-8f5d-172fe08d7d30', 'volume_size': 1}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-486553519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=304e54fb-38d3-457e-8f5d-172fe08d7d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a942b57c91a4441eb196399f59d59d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:28Z,use_quota=True,user_id='58a9e48ea4024557a94a78ba660b6913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Creating volume 304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:42:28 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:28 devstack sudo[98664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696
Nov 05 18:42:28 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:28 devstack sudo[98665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 1073741824
Nov 05 18:42:28 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:28 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696" returned: 0 in 0.469s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:28 devstack sudo[98676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696
Nov 05 18:42:28 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:28 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 1073741824" returned: 0 in 0.513s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:28 devstack sudo[98678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30
Nov 05 18:42:28 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:28 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0c4bc113-ee00-4cda-8a8a-e968c4aca696" returned: 0 in 0.310s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Lock "cinder-quobyte-0c4bc113-ee00-4cda-8a8a-e968c4aca696" released by "delete_volume" :: held 0.902s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Created reservations ['4250b3c6-fce7-4576-afb6-64263edb13cc'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:28 devstack cinder-volume[87086]: WARNING cinder.quota [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1661121137 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1661121137, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:42:28 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Created reservations ['ca5eb3ea-852b-457e-99d3-174314a7c309', 'fa0c81b6-8f85-4f93-beab-22e3ab2b1d5e', '778298de-22f3-43bd-b5a7-e92075aac513', 'ad43b513-5b8f-425e-a7ac-a71f3ddc7e1d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:29 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30" returned: 0 in 0.352s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Flow 'volume_create_manager' (8bdca346-3f7e-4fb7-9ce2-43fe8e7f7792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e7cb1b-938f-443e-84fa-d9bbf6c5ce48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e7cb1b-938f-443e-84fa-d9bbf6c5ce48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1028623393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a286e25-0c59-4b42-8caa-010d177b0a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5482ac349e29430cb1d082868cf0f2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:29Z,use_quota=True,user_id='a1fd4f05f4a64c8a8b18605107fe86c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b955b3cd-329c-4ba9-b023-fba4b53dc786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b955b3cd-329c-4ba9-b023-fba4b53dc786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb85260-07f1-44e1-8be3-c6b0c35fe266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.image.glance [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Creating Keystone auth plugin from conf {{(pid=87086) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8476e4-b71a-43de-8970-982394acbba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-304e54fb-38d3-457e-8f5d-172fe08d7d30', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a86102-43d5-4359-85be-81a824976a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:29 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Volume volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 (304e54fb-38d3-457e-8f5d-172fe08d7d30): created successfully
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a86102-43d5-4359-85be-81a824976a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Flow 'volume_create_manager' (e81f3306-c83d-40a6-ac20-3591486dfd38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:29 devstack sudo[98682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:42:29 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-473bb848-efee-4987-b05b-34b8bf248cac tempest-VolumesSnapshotListTestJSON-1628894457 None] Created volume successfully.
Nov 05 18:42:29 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.257s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:42:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a0fe713c-a239-4c73-9e1a-773618f102ba tempest-GroupSnapshotsTest-46186209 None] Delete group completed successfully.
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb85260-07f1-44e1-8be3-c6b0c35fe266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a286e25-0c59-4b42-8caa-010d177b0a3f', 'volume_name': 'volume-6a286e25-0c59-4b42-8caa-010d177b0a3f', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf47fc470>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81aec95-3d49-4d0d-bff0-a95ed072eccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a81aec95-3d49-4d0d-bff0-a95ed072eccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1458fcf-a65b-498e-af86-6200a6ec2966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:29 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Volume 6a286e25-0c59-4b42-8caa-010d177b0a3f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a286e25-0c59-4b42-8caa-010d177b0a3f', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf47fc470>}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Trying to clone 6a286e25-0c59-4b42-8caa-010d177b0a3f from image f12bcbef-da90-40ac-bcfe-4218bc9aa565 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]). {{(pid=87086) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 18:42:29 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4fa788-4564-44b1-9128-99fcb7eaedbb]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:30 devstack sudo[98686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD
Nov 05 18:42:30 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Creating offline snapshot a9fcab4a-8eda-4796-8234-ad6b2ba1f789 of volume 304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:42:30 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Temporary image f12bcbef-da90-40ac-bcfe-4218bc9aa565 is fetched for user a1fd4f05f4a64c8a8b18605107fe86c5. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[305db97c-f792-4ba3-affc-2d48b7128b49]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3512b9de-5677-4b3f-862f-f89c605b1829]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:30 devstack sudo[98692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30
Nov 05 18:42:30 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:30 devstack sudo[98693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD
Nov 05 18:42:30 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:30 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30" returned: 0 in 0.509s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:30 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:30 devstack sudo[98704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 1G
Nov 05 18:42:30 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:31 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 1G" returned: 0 in 0.495s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:31 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789
Nov 05 18:42:31 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:31 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789" returned: 0 in 0.310s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:31 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 is being set with open permissions: ugo+rw
Nov 05 18:42:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:31 devstack sudo[98715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789
Nov 05 18:42:31 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:31 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789" returned: 0 in 0.279s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:32 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.info
Nov 05 18:42:32 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:32 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.info" returned: 0 in 0.279s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:32 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.info is being set with open permissions: ugo+rw
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:32 devstack sudo[98721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.info
Nov 05 18:42:32 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:32 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.info" returned: 0 in 0.293s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.707s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1028623393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a286e25-0c59-4b42-8caa-010d177b0a3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5482ac349e29430cb1d082868cf0f2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:29Z,use_quota=True,user_id='a1fd4f05f4a64c8a8b18605107fe86c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Creating volume 6a286e25-0c59-4b42-8caa-010d177b0a3f {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:42:32 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:42:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:32 devstack sudo[98724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f 1073741824
Nov 05 18:42:32 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3aafe6f7-bf61-4df8-9d25-296a9b6bfac0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Create snapshot completed successfully
Nov 05 18:42:33 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f 1073741824" returned: 0 in 0.587s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:33 devstack sudo[98730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f
Nov 05 18:42:33 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:33 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f" returned: 0 in 0.302s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Attempting download of f12bcbef-da90-40ac-bcfe-4218bc9aa565 ((None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}])) to volume 6a286e25-0c59-4b42-8caa-010d177b0a3f. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[805f3857-b567-4c57-8cfa-01c3ce74d366]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_c67q4ye7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] Creating offline snapshot 9dd3a07d-8cc6-4425-8675-d7bba9be68e8 of volume 304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[be77a862-8837-4a91-8c2a-df9a0c09d959]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:33 devstack sudo[98733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_c67q4ye7
Nov 05 18:42:33 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:33 devstack sudo[98734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789
Nov 05 18:42:33 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:34 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_c67q4ye7" returned: 0 in 0.444s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_c67q4ye7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:34 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789" returned: 0 in 0.463s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-304e54fb-38d3-457e-8f5d-172fe08d7d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:34 devstack sudo[98744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 1G
Nov 05 18:42:34 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:34 devstack sudo[98739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_c67q4ye7
Nov 05 18:42:34 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:34 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_c67q4ye7" returned: 1 in 0.398s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_c67q4ye7' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9074a1-66fc-4ae2-a4c9-490f3571a8a8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:34 devstack sudo[98751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD
Nov 05 18:42:34 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:34 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 1G" returned: 0 in 0.593s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:34 devstack sudo[98755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8
Nov 05 18:42:34 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:34 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] f12bcbef-da90-40ac-bcfe-4218bc9aa565 was qcow2, converting to qcow2 {{(pid=87086) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 18:42:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:34 devstack sudo[98761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f
Nov 05 18:42:34 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:35 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8" returned: 0 in 0.385s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:35 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 is being set with open permissions: ugo+rw
Nov 05 18:42:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:35 devstack sudo[98771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8
Nov 05 18:42:35 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:35 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8" returned: 0 in 0.307s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:35 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a7c25b92-8fe7-40c6-9cd6-d466c29a3983 tempest-VolumesSnapshotListTestJSON-1628894457 None] Create snapshot completed successfully
Nov 05 18:42:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] Creating offline snapshot 4efd1e1a-3852-4866-9308-842489204b15 of volume 304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:42:36 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef7e1dd-a0cd-452b-866f-69f746bd6c23]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0ab14439-24c9-4e52-a959-c99c82dbb062 tempest-GroupSnapshotsV319Test-550589640 None] Group tempest-GroupSnapshotsV319Test-Group-267821476: creating
Nov 05 18:42:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0ab14439-24c9-4e52-a959-c99c82dbb062 tempest-GroupSnapshotsV319Test-550589640 None] Group tempest-GroupSnapshotsV319Test-Group-267821476: created successfully
Nov 05 18:42:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0ab14439-24c9-4e52-a959-c99c82dbb062 tempest-GroupSnapshotsV319Test-550589640 None] Create group completed successfully.
Nov 05 18:42:36 devstack sudo[98776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8
Nov 05 18:42:36 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:36 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8" returned: 0 in 0.458s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-304e54fb-38d3-457e-8f5d-172fe08d7d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:36 devstack sudo[98781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15 1G
Nov 05 18:42:36 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:37 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15 1G" returned: 0 in 0.623s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:37 devstack sudo[98790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15
Nov 05 18:42:37 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:37 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f" returned: 0 in 2.359s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_za7bfm_adevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:42:37 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Converted 112.00 MB image at 47.44 MB/s
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:37 devstack sudo[98792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f 1G
Nov 05 18:42:37 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:37 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15" returned: 0 in 0.381s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:37 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15 is being set with open permissions: ugo+rw
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:37 devstack sudo[98799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15
Nov 05 18:42:37 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:37 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f 1G" returned: 0 in 0.502s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Downloaded image f12bcbef-da90-40ac-bcfe-4218bc9aa565 ((None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}])) to volume 6a286e25-0c59-4b42-8caa-010d177b0a3f successfully. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Temporary image f12bcbef-da90-40ac-bcfe-4218bc9aa565 for user a1fd4f05f4a64c8a8b18605107fe86c5 is deleted. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Marking volume 6a286e25-0c59-4b42-8caa-010d177b0a3f as bootable. {{(pid=87086) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Copying metadata from image f12bcbef-da90-40ac-bcfe-4218bc9aa565 to 6a286e25-0c59-4b42-8caa-010d177b0a3f. {{(pid=87086) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Creating volume glance metadata for volume 6a286e25-0c59-4b42-8caa-010d177b0a3f backed by image f12bcbef-da90-40ac-bcfe-4218bc9aa565 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87086) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 18:42:37 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15" returned: 0 in 0.382s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:37 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Flow 'volume_create_manager' (7eb4091f-facf-416c-ba82-41f4d7e534e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ddc0d8-8e62-4b04-8bc5-4b6c6e24b85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ddc0d8-8e62-4b04-8bc5-4b6c6e24b85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-794299666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77971e86-a8cc-450a-a8fb-7ba6bc8aab78,host='devstack@QuobyteHD#QuobyteHD',id=cfea33ad-a18d-488d-9b8e-12e79c43eee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461ea07010fb423cbc45958df61d03f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:38Z,use_quota=True,user_id='fb9e4dfca19a4d89a661edf0fdeb46eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16ed3a1b-08f1-418e-a0b0-e78d8cda695f),volume_type_id=16ed3a1b-08f1-418e-a0b0-e78d8cda695f)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81263a71-9a75-4a21-9459-954ad0f15988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81263a71-9a75-4a21-9459-954ad0f15988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8425997a-b37e-4768-aaa3-59889849e6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8425997a-b37e-4768-aaa3-59889849e6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfea33ad-a18d-488d-9b8e-12e79c43eee7', 'volume_name': 'volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bade17f-2bf7-4be9-b57b-709f6760760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bade17f-2bf7-4be9-b57b-709f6760760c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f8f970-98bb-446a-9323-bc02dd51be84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:38 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Volume cfea33ad-a18d-488d-9b8e-12e79c43eee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7', 'volume_size': 1}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=77971e86-a8cc-450a-a8fb-7ba6bc8aab78,created_at=2026-11-05T17:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-794299666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=77971e86-a8cc-450a-a8fb-7ba6bc8aab78,host='devstack@QuobyteHD#QuobyteHD',id=cfea33ad-a18d-488d-9b8e-12e79c43eee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461ea07010fb423cbc45958df61d03f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:38Z,use_quota=True,user_id='fb9e4dfca19a4d89a661edf0fdeb46eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16ed3a1b-08f1-418e-a0b0-e78d8cda695f),volume_type_id=16ed3a1b-08f1-418e-a0b0-e78d8cda695f)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Creating volume cfea33ad-a18d-488d-9b8e-12e79c43eee7 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:42:38 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:38 devstack sudo[98803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 1073741824
Nov 05 18:42:38 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:38 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-97680dee-0b89-4c8e-ba56-2c77d5bee11d tempest-VolumesSnapshotListTestJSON-1628894457 None] Create snapshot completed successfully
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1458fcf-a65b-498e-af86-6200a6ec2966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a286e25-0c59-4b42-8caa-010d177b0a3f', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf47fc470>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2edc2ca-e388-48da-a9c0-87fffcd91b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:38 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Volume volume-6a286e25-0c59-4b42-8caa-010d177b0a3f (6a286e25-0c59-4b42-8caa-010d177b0a3f): created successfully
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2edc2ca-e388-48da-a9c0-87fffcd91b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Flow 'volume_create_manager' (8bdca346-3f7e-4fb7-9ce2-43fe8e7f7792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:38 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9a0bfa21-dad1-468e-b813-ab795c5e200e tempest-TestShelveInstance-2027199727 None] Created volume successfully.
Nov 05 18:42:38 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 1073741824" returned: 0 in 0.457s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:38 devstack sudo[98810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7
Nov 05 18:42:38 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:38 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7" returned: 0 in 0.252s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f8f970-98bb-446a-9323-bc02dd51be84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b321f725-262d-4a5c-8899-bb6f39cc8b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:38 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Volume volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 (cfea33ad-a18d-488d-9b8e-12e79c43eee7): created successfully
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b321f725-262d-4a5c-8899-bb6f39cc8b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Flow 'volume_create_manager' (7eb4091f-facf-416c-ba82-41f4d7e534e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:38 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-97a004ef-b6f0-4ceb-b9f5-5cf46b04f9d8 tempest-GroupSnapshotsV319Test-550589640 None] Created volume successfully.
Nov 05 18:42:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] GroupSnapshot 8a71fd28-f6a0-4a4b-9f8f-420305938589: creating.
Nov 05 18:42:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Group snapshot 8a71fd28-f6a0-4a4b-9f8f-420305938589: creating. {{(pid=87086) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 18:42:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Creating offline snapshot 1d15ab3f-3a7d-451f-947d-60c3fc35f380 of volume cfea33ad-a18d-488d-9b8e-12e79c43eee7 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:42:39 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8a2916-ef96-4801-91b5-452cd383acbe]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:39 devstack sudo[98813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7
Nov 05 18:42:39 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:40 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7" returned: 0 in 0.559s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:40 devstack sudo[98818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380 1G
Nov 05 18:42:40 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-4efd1e1a-3852-4866-9308-842489204b15-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-4efd1e1a-3852-4866-9308-842489204b15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-quobyte-4efd1e1a-3852-4866-9308-842489204b15" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-4efd1e1a-3852-4866-9308-842489204b15" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Deleting offline snapshot 4efd1e1a-3852-4866-9308-842489204b15 of volume 304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] snapshot_file for this snap is: volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f75c4da-a6b4-4645-be60-e819ad6124a4]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:40 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380 1G" returned: 0 in 0.668s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:40 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380
Nov 05 18:42:40 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:40 devstack sudo[98828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15
Nov 05 18:42:40 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:41 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380" returned: 0 in 0.398s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:41 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:41 devstack sudo[98839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380
Nov 05 18:42:41 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:41 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15" returned: 0 in 0.504s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-304e54fb-38d3-457e-8f5d-172fe08d7d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[048d7a9d-346d-45eb-a120-b8bbed9e5f67]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:41 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8
Nov 05 18:42:41 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:41 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380" returned: 0 in 0.317s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:41 devstack sudo[98845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.info
Nov 05 18:42:41 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:41 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8" returned: 0 in 0.463s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-304e54fb-38d3-457e-8f5d-172fe08d7d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:41 devstack sudo[98852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15
Nov 05 18:42:41 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:42 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.info" returned: 0 in 0.363s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:42 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:42:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:42 devstack sudo[98855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.info
Nov 05 18:42:42 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:42 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.info" returned: 0 in 0.388s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.880s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:42 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15" returned: 0 in 0.707s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:42 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0a504369-e4e8-4bc4-a7ce-8b3d548af4fd tempest-GroupSnapshotsV319Test-550589640 None] group_snapshot 8a71fd28-f6a0-4a4b-9f8f-420305938589: created successfully
Nov 05 18:42:42 devstack sudo[98861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15
Nov 05 18:42:42 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:42 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.4efd1e1a-3852-4866-9308-842489204b15" returned: 0 in 0.333s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-4efd1e1a-3852-4866-9308-842489204b15" released by "_delete_snapshot" :: held 2.204s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" released by "delete_snapshot" :: held 2.248s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Created reservations ['013b2c17-cb29-4981-ad0b-261056b852f5', 'b862624e-38b4-4388-884f-184adc2bbe34', '54da84e7-51a6-4c20-9fba-6eac5c5e9245', '162e0769-430b-4709-a047-1345bd87a4bb'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Delete snapshot completed successfully.
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c8be7cb5-cc3b-482c-bbf3-e7b1d9e5d69b tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-4efd1e1a-3852-4866-9308-842489204b15-delete_snapshot" released by "delete_snapshot" :: held 2.492s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-fe4dc8dc-b57d-44f2-9ab9-2cbcaba5d7bf req-4abd8fd5-1e54-4706-970c-4906daeae43d tempest-TestShelveInstance-2027199727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-fe4dc8dc-b57d-44f2-9ab9-2cbcaba5d7bf req-4abd8fd5-1e54-4706-970c-4906daeae43d tempest-TestShelveInstance-2027199727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-fe4dc8dc-b57d-44f2-9ab9-2cbcaba5d7bf req-4abd8fd5-1e54-4706-970c-4906daeae43d tempest-TestShelveInstance-2027199727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] group_snapshot 8a71fd28-f6a0-4a4b-9f8f-420305938589: deleting
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-fe4dc8dc-b57d-44f2-9ab9-2cbcaba5d7bf req-4abd8fd5-1e54-4706-970c-4906daeae43d tempest-TestShelveInstance-2027199727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-6a286e25-0c59-4b42-8caa-010d177b0a3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2eebc05c-2a7a-4b48-b186-e8b49dbe7948', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] group_snapshot 8a71fd28-f6a0-4a4b-9f8f-420305938589: deleting {{(pid=87086) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Acquiring lock "cinder-quobyte-cfea33ad-a18d-488d-9b8e-12e79c43eee7" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Lock "cinder-quobyte-cfea33ad-a18d-488d-9b8e-12e79c43eee7" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Acquiring lock "cinder-quobyte-1d15ab3f-3a7d-451f-947d-60c3fc35f380" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-fe4dc8dc-b57d-44f2-9ab9-2cbcaba5d7bf req-4abd8fd5-1e54-4706-970c-4906daeae43d tempest-TestShelveInstance-2027199727 None] attachment_update completed successfully.
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Lock "cinder-quobyte-1d15ab3f-3a7d-451f-947d-60c3fc35f380" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Deleting offline snapshot 1d15ab3f-3a7d-451f-947d-60c3fc35f380 of volume cfea33ad-a18d-488d-9b8e-12e79c43eee7 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] snapshot_file for this snap is: volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1a52a4-1a79-4a69-89d8-1fe3fb61659b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:43 devstack sudo[98872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380
Nov 05 18:42:43 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-9dd3a07d-8cc6-4425-8675-d7bba9be68e8-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-9dd3a07d-8cc6-4425-8675-d7bba9be68e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-quobyte-9dd3a07d-8cc6-4425-8675-d7bba9be68e8" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-9dd3a07d-8cc6-4425-8675-d7bba9be68e8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Deleting offline snapshot 9dd3a07d-8cc6-4425-8675-d7bba9be68e8 of volume 304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] snapshot_file for this snap is: volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:42:44 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380" returned: 0 in 0.540s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd54108-7bdc-4357-88bb-dc0a6fc13493]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[710213ce-6f49-4661-b040-bbde8d4cbeaf]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:44 devstack sudo[98878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7
Nov 05 18:42:44 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:44 devstack sudo[98877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8
Nov 05 18:42:44 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:44 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7" returned: 0 in 0.466s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:44 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8" returned: 0 in 0.511s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-304e54fb-38d3-457e-8f5d-172fe08d7d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:44 devstack sudo[98887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380
Nov 05 18:42:44 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[807c7b68-908b-49a0-a05a-6ac105ce61d3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:45 devstack sudo[98892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789
Nov 05 18:42:45 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:45 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380" returned: 0 in 0.497s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:45 devstack sudo[98919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380
Nov 05 18:42:45 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:45 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789" returned: 0 in 0.490s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-304e54fb-38d3-457e-8f5d-172fe08d7d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:45 devstack sudo[98941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8
Nov 05 18:42:45 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:45 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7.1d15ab3f-3a7d-451f-947d-60c3fc35f380" returned: 0 in 0.298s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Lock "cinder-quobyte-1d15ab3f-3a7d-451f-947d-60c3fc35f380" released by "_delete_snapshot" :: held 1.963s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Lock "cinder-quobyte-cfea33ad-a18d-488d-9b8e-12e79c43eee7" released by "delete_snapshot" :: held 1.995s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:45 devstack cinder-volume[87086]: WARNING cinder.quota [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1235939950 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1235939950, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:42:45 devstack cinder-volume[87086]: WARNING cinder.quota [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1235939950 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1235939950, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:42:45 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] Created reservations ['0f690e23-5dd8-493b-88a7-ee65e7235fc9', 'c2e7d4ff-7e3c-43d5-801c-661a7d2b2af5', '53f36408-6197-43ea-abad-95c78d07bb82', '9e7f36c9-800e-41ab-9a33-1d0283656bb3'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-aa8b18eb-29be-4b2c-9db4-3aa4aa4c39a7 tempest-GroupSnapshotsV319Test-550589640 None] group_snapshot 8a71fd28-f6a0-4a4b-9f8f-420305938589: deleted successfully
Nov 05 18:42:46 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8" returned: 0 in 0.679s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:46 devstack sudo[98950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8
Nov 05 18:42:46 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:46 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.9dd3a07d-8cc6-4425-8675-d7bba9be68e8" returned: 0 in 0.366s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-9dd3a07d-8cc6-4425-8675-d7bba9be68e8" released by "_delete_snapshot" :: held 2.201s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" released by "delete_snapshot" :: held 2.228s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Created reservations ['fb4cd6ff-c9a3-4bd9-aa87-eac65322409a', '43162ff2-3b3f-4463-be2d-1bb8c80a222c', 'b2f1f1d0-a4e6-4005-965c-2206f3a92944', 'b930312c-ef94-45ff-a4f4-7b25760b53cf'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Acquiring lock "cinder-quobyte-cfea33ad-a18d-488d-9b8e-12e79c43eee7" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Lock "cinder-quobyte-cfea33ad-a18d-488d-9b8e-12e79c43eee7" acquired by "delete_volume" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4104a092-3040-43d4-a7ac-62938b72930d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Delete snapshot completed successfully.
Nov 05 18:42:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f7d07801-dbdb-43c6-99c2-6aacdd8310af tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-9dd3a07d-8cc6-4425-8675-d7bba9be68e8-delete_snapshot" released by "delete_snapshot" :: held 2.531s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:46 devstack sudo[98953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7
Nov 05 18:42:46 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8101c69b-2a67-44d4-b4f5-fb1a38a6af26 tempest-GroupsV314Test-2079085841 None] Group tempest-GroupsV314Test-Group-1246963446: creating
Nov 05 18:42:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8101c69b-2a67-44d4-b4f5-fb1a38a6af26 tempest-GroupsV314Test-2079085841 None] Group tempest-GroupsV314Test-Group-1246963446: created successfully
Nov 05 18:42:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8101c69b-2a67-44d4-b4f5-fb1a38a6af26 tempest-GroupsV314Test-2079085841 None] Create group completed successfully.
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7" returned: 0 in 0.486s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:47 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:47 devstack sudo[99058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7
Nov 05 18:42:47 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-a9fcab4a-8eda-4796-8234-ad6b2ba1f789-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-a9fcab4a-8eda-4796-8234-ad6b2ba1f789-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-quobyte-a9fcab4a-8eda-4796-8234-ad6b2ba1f789" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-a9fcab4a-8eda-4796-8234-ad6b2ba1f789" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Deleting offline snapshot a9fcab4a-8eda-4796-8234-ad6b2ba1f789 of volume 304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] snapshot_file for this snap is: volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:42:47 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cfea33ad-a18d-488d-9b8e-12e79c43eee7" returned: 0 in 0.606s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[0515dd43-c6d1-4c33-8987-37152562cb7b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Lock "cinder-quobyte-cfea33ad-a18d-488d-9b8e-12e79c43eee7" released by "delete_volume" :: held 1.253s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:47 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=164,cinder:DELETE=8,cinder:SELECT=184,cinder:INSERT=51 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Created reservations ['27206479-7c57-4200-8cfd-7b8ede1cde89'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:48 devstack sudo[99416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789
Nov 05 18:42:48 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:48 devstack cinder-volume[87086]: WARNING cinder.quota [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1235939950 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1235939950, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Created reservations ['36e02509-074d-4a24-8269-1b1b5f2afe80', '645bab6e-667e-4922-b39c-17c19010822f', '06da449c-69c7-418b-ade8-97c11a1c578c', 'f3812f1d-c3c1-4f28-8cc1-1d3385d0d658'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=174,cinder:SELECT=183,cinder:INSERT=53,cinder:DELETE=10 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:48 devstack sudo[99441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:42:48 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:48 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789" returned: 0 in 0.668s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-304e54fb-38d3-457e-8f5d-172fe08d7d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[546f27cc-37d6-436d-a6f6-6cb3d2aebbec]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:48 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.317s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:48 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:42:48 devstack sudo[99446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30
Nov 05 18:42:48 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:48 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1b95d749-836d-4fba-931d-3a8233bbea2e tempest-GroupSnapshotsV319Test-550589640 None] Delete group completed successfully.
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Flow 'volume_create_manager' (4121b765-d8aa-43db-afaf-a2c66c291d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013340bc-8150-44c9-8484-7419a597a67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (013340bc-8150-44c9-8484-7419a597a67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512676575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cb3c3c0d-254f-4161-9d2d-4e2195a2767c,host='devstack@QuobyteHD#QuobyteHD',id=21e65bb2-4f36-4edf-be9a-4919e26a3e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1ce63ad61949018049587ca2f368ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:49Z,use_quota=True,user_id='87fd4ffb4b8f4e2ebe11ab09401c625b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b8fe1e5-2b98-45b8-96a6-8348bf383d52),volume_type_id=1b8fe1e5-2b98-45b8-96a6-8348bf383d52)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87049aa-9d28-4b04-bfab-f74302f3058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87049aa-9d28-4b04-bfab-f74302f3058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b543ad9c-7d20-40a8-8b37-4cb6d636346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b543ad9c-7d20-40a8-8b37-4cb6d636346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e65bb2-4f36-4edf-be9a-4919e26a3e4f', 'volume_name': 'volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782fa2a7-a613-4979-aae7-9d8647d6f19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782fa2a7-a613-4979-aae7-9d8647d6f19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1654ad-0238-4909-baa1-58040aa7dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:49 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Volume 21e65bb2-4f36-4edf-be9a-4919e26a3e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f', 'volume_size': 1}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cb3c3c0d-254f-4161-9d2d-4e2195a2767c,created_at=2026-11-05T17:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512676575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cb3c3c0d-254f-4161-9d2d-4e2195a2767c,host='devstack@QuobyteHD#QuobyteHD',id=21e65bb2-4f36-4edf-be9a-4919e26a3e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1ce63ad61949018049587ca2f368ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:42:49Z,use_quota=True,user_id='87fd4ffb4b8f4e2ebe11ab09401c625b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b8fe1e5-2b98-45b8-96a6-8348bf383d52),volume_type_id=1b8fe1e5-2b98-45b8-96a6-8348bf383d52)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Creating volume 21e65bb2-4f36-4edf-be9a-4919e26a3e4f {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:42:49 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:42:49 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30" returned: 0 in 0.846s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:49 devstack sudo[99454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f 1073741824
Nov 05 18:42:49 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:49 devstack sudo[99455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789
Nov 05 18:42:49 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:49 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789" returned: 0 in 0.551s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:50 devstack sudo[99467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789
Nov 05 18:42:50 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:50 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f 1073741824" returned: 0 in 0.884s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:50 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30.a9fcab4a-8eda-4796-8234-ad6b2ba1f789" returned: 0 in 0.379s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:50 devstack sudo[99472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f
Nov 05 18:42:50 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-a9fcab4a-8eda-4796-8234-ad6b2ba1f789" released by "_delete_snapshot" :: held 2.764s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" released by "delete_snapshot" :: held 2.804s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Created reservations ['0b714322-aab1-41d2-9a48-b3fc179b796b', 'deac1c93-4d70-4aa7-91a7-868dc1c22c90', '2f3f3c8c-79be-4814-b4ee-5c75d6c60b76', 'e510001d-69c8-43c4-8136-0f8fc66d6598'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:50 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Delete snapshot completed successfully.
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f6b1edf8-8ae1-4804-bfc8-a75340ee46a0 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-a9fcab4a-8eda-4796-8234-ad6b2ba1f789-delete_snapshot" released by "delete_snapshot" :: held 3.135s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:50 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f" returned: 0 in 0.466s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1654ad-0238-4909-baa1-58040aa7dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92992d1-f8ca-4639-8f91-24948b519729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:42:50 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Volume volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f (21e65bb2-4f36-4edf-be9a-4919e26a3e4f): created successfully
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a92992d1-f8ca-4639-8f91-24948b519729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:42:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Flow 'volume_create_manager' (4121b765-d8aa-43db-afaf-a2c66c291d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:42:51 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-014dd38b-f978-444b-bb7f-34bf1dea34b8 tempest-GroupsV314Test-2079085841 None] Created volume successfully.
Nov 05 18:42:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-304e54fb-38d3-457e-8f5d-172fe08d7d30-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-304e54fb-38d3-457e-8f5d-172fe08d7d30-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:51 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2bc608-4f18-4725-aeda-3954d5b31e2e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:51 devstack sudo[99475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30
Nov 05 18:42:51 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:51 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30" returned: 0 in 0.449s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:51 devstack sudo[99480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30
Nov 05 18:42:51 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:52 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-304e54fb-38d3-457e-8f5d-172fe08d7d30" returned: 0 in 0.500s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-quobyte-304e54fb-38d3-457e-8f5d-172fe08d7d30" released by "delete_volume" :: held 1.089s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:52 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Created reservations ['9813f216-d2f4-4f95-b9ce-190807ff0791', '29dc34a1-88f4-4f3e-b80b-f2b7706a69e5', '2c0e2a8a-f899-43dd-aac6-41bebde3acfb', 'a149ff67-bf1b-4645-8c95-fa1bd0f9d999'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:42:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:52 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:42:52 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:53 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.535s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:53 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:42:53 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Deleted volume successfully.
Nov 05 18:42:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-265d7f9e-ef0b-4b68-b0ed-458497dbd171 tempest-VolumesSnapshotListTestJSON-1628894457 None] Lock "cinder-304e54fb-38d3-457e-8f5d-172fe08d7d30-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:42:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:53 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Cloning volume 21e65bb2-4f36-4edf-be9a-4919e26a3e4f to volume 93ee7acf-e952-440a-96ec-dd727f2296db
Nov 05 18:42:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Creating offline snapshot 5afd50cf-edb4-4dea-803f-7ce59006af84 of volume 21e65bb2-4f36-4edf-be9a-4919e26a3e4f {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:42:53 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac712e4f-8438-44e2-914d-d7fbf740ecd0]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:53 devstack sudo[99486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f
Nov 05 18:42:53 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:54 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f" returned: 0 in 0.882s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:54 devstack sudo[99491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 1G
Nov 05 18:42:54 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:55 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 1G" returned: 0 in 0.712s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:55 devstack sudo[99497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84
Nov 05 18:42:55 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:55 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84" returned: 0 in 0.521s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:55 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:42:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:55 devstack sudo[99503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84
Nov 05 18:42:55 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:56 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84" returned: 0 in 0.391s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:56 devstack sudo[99506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.info
Nov 05 18:42:56 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:56 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.info" returned: 0 in 0.398s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:56 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:56 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.info
Nov 05 18:42:56 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:56 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.info" returned: 0 in 0.308s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Acquiring lock "cinder-quobyte-93ee7acf-e952-440a-96ec-dd727f2296db" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Lock "cinder-quobyte-93ee7acf-e952-440a-96ec-dd727f2296db" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] snapshot: 5afd50cf-edb4-4dea-803f-7ce59006af84, volume: 93ee7acf-e952-440a-96ec-dd727f2296db,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:42:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:42:57 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17b80f9-dd1e-407a-90a9-08fbad1e58b3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:57 devstack sudo[99513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84
Nov 05 18:42:57 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:57 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84" returned: 0 in 0.560s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:42:57 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeac1c2-5a37-4f02-8c12-e84f975af74b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:42:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:57 devstack sudo[99518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f
Nov 05 18:42:57 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:42:58 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root
Nov 05 18:42:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f" returned: 0 in 0.624s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:42:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:42:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:42:58 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:42:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:42:58 devstack sudo[99523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db
Nov 05 18:42:58 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:06 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=18,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:43:06 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:INSERT=9,cinder:SELECT=25,cinder:UPDATE=28 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:43:07 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db" returned: 0 in 9.304s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:07 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f, size 1024.00 MB, duration 9.31 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:43:07 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Converted 1024.00 MB image at 110.04 MB/s
Nov 05 18:43:07 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 18:43:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:07 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db
Nov 05 18:43:07 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:07 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db" returned: 0 in 0.340s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Lock "cinder-quobyte-93ee7acf-e952-440a-96ec-dd727f2296db" released by "_copy_volume_from_snapshot" :: held 10.974s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Acquiring lock "cinder-quobyte-5afd50cf-edb4-4dea-803f-7ce59006af84" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Lock "cinder-quobyte-5afd50cf-edb4-4dea-803f-7ce59006af84" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Deleting offline snapshot 5afd50cf-edb4-4dea-803f-7ce59006af84 of volume 21e65bb2-4f36-4edf-be9a-4919e26a3e4f {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:43:07 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] snapshot_file for this snap is: volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfa2025-332d-422b-b32c-4758fbcd35f2]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:08 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84
Nov 05 18:43:08 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:43:08 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Flow 'volume_create_manager' (46af7a71-b456-4518-881e-6aa5a1327be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3791ad6-118b-4d56-9d39-d5e4256a317e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84" returned: 0 in 0.632s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3791ad6-118b-4d56-9d39-d5e4256a317e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9937eb-6952-4915-902d-4dcb5076bdf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23969f1141664f9c90080f002ba5a21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:43:09Z,use_quota=True,user_id='7a60f5cce58c4d71bc3ed00883518669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d978c7-5e09-42c2-a4f9-d5dc51dfc133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d978c7-5e09-42c2-a4f9-d5dc51dfc133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b376d3cc-3455-4916-b7ca-719336d6c6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG cinder.image.glance [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Creating Keystone auth plugin from conf {{(pid=87086) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[58297f1c-3e1d-4a36-9c2d-808d9724b839]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:08 devstack sudo[99581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f
Nov 05 18:43:08 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b376d3cc-3455-4916-b7ca-719336d6c6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c9937eb-6952-4915-902d-4dcb5076bdf1', 'volume_name': 'volume-6c9937eb-6952-4915-902d-4dcb5076bdf1', 'volume_size': 1, 'image_id': 'dcb043b3-944f-4682-ad99-77e84bcd26fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcb043b3-944f-4682-ad99-77e84bcd26fb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '787841f1576c62482c7ae95748804b95', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23969f1141664f9c90080f002ba5a21f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ddd877d92ca7c12be4b3d85e090c9b985eadbb6fb064d7b65e25f7407930afd515397b71b042fa0a2fe577e9c03dd4964e0a7b5063b48aa781a7a761beff109', 'id': 'dcb043b3-944f-4682-ad99-77e84bcd26fb', 'created_at': datetime.datetime(2026, 11, 5, 17, 43, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcb043b3-944f-4682-ad99-77e84bcd26fb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea3be2d0>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916729d8-10e7-436b-8fc4-61b6dac3ffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (916729d8-10e7-436b-8fc4-61b6dac3ffa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f479b9aa-061a-4fa2-9951-7fe844331b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:09 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Volume 6c9937eb-6952-4915-902d-4dcb5076bdf1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c9937eb-6952-4915-902d-4dcb5076bdf1', 'volume_size': 1, 'image_id': 'dcb043b3-944f-4682-ad99-77e84bcd26fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcb043b3-944f-4682-ad99-77e84bcd26fb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '787841f1576c62482c7ae95748804b95', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23969f1141664f9c90080f002ba5a21f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ddd877d92ca7c12be4b3d85e090c9b985eadbb6fb064d7b65e25f7407930afd515397b71b042fa0a2fe577e9c03dd4964e0a7b5063b48aa781a7a761beff109', 'id': 'dcb043b3-944f-4682-ad99-77e84bcd26fb', 'created_at': datetime.datetime(2026, 11, 5, 17, 43, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcb043b3-944f-4682-ad99-77e84bcd26fb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea3be2d0>}
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Trying to clone 6c9937eb-6952-4915-902d-4dcb5076bdf1 from image dcb043b3-944f-4682-ad99-77e84bcd26fb at location (None, [{'url': 'file:///opt/stack/data/glance/images/dcb043b3-944f-4682-ad99-77e84bcd26fb', 'metadata': {}}]). {{(pid=87086) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 18:43:09 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[0721244c-c904-4b91-b7b0-13d96fdec899]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:09 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f" returned: 0 in 0.759s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:09 devstack sudo[99587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84
Nov 05 18:43:09 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:09 devstack sudo[99586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD
Nov 05 18:43:09 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:09 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:09 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84" returned: 0 in 0.417s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:09 devstack sudo[99597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84
Nov 05 18:43:09 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:09 devstack sudo[99596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD
Nov 05 18:43:09 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:10 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f.5afd50cf-edb4-4dea-803f-7ce59006af84" returned: 0 in 0.283s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Lock "cinder-quobyte-5afd50cf-edb4-4dea-803f-7ce59006af84" released by "_delete_snapshot" :: held 2.269s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:10 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:43:10 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Temporary image dcb043b3-944f-4682-ad99-77e84bcd26fb is fetched for user 7a60f5cce58c4d71bc3ed00883518669. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 18:43:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.826s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:10 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457e801-5d16-4315-97e8-337b6e718ef1]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:10 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5480e289-9e36-4001-9919-60dd965089df tempest-GroupsV314Test-2079085841 None] Create group from source-group-cb3c3c0d-254f-4161-9d2d-4e2195a2767c completed successfully.
Nov 05 18:43:10 devstack sudo[99604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD
Nov 05 18:43:10 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:10 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:10 devstack sudo[99608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD
Nov 05 18:43:10 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:11 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9937eb-6952-4915-902d-4dcb5076bdf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23969f1141664f9c90080f002ba5a21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:43:09Z,use_quota=True,user_id='7a60f5cce58c4d71bc3ed00883518669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Creating volume 6c9937eb-6952-4915-902d-4dcb5076bdf1 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:43:11 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:11 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 1073741824
Nov 05 18:43:11 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:11 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 1073741824" returned: 0 in 0.571s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Acquiring lock "cinder-quobyte-93ee7acf-e952-440a-96ec-dd727f2296db" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Lock "cinder-quobyte-93ee7acf-e952-440a-96ec-dd727f2296db" acquired by "delete_volume" :: waited 0.035s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:11 devstack sudo[99619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1
Nov 05 18:43:11 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3750e153-63bd-4ebc-8f47-644f4905cd95]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:11 devstack sudo[99621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db
Nov 05 18:43:11 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:11 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1" returned: 0 in 0.311s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:43:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Attempting download of dcb043b3-944f-4682-ad99-77e84bcd26fb ((None, [{'url': 'file:///opt/stack/data/glance/images/dcb043b3-944f-4682-ad99-77e84bcd26fb', 'metadata': {}}])) to volume 6c9937eb-6952-4915-902d-4dcb5076bdf1. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb4e4a-532f-4756-a615-2837874464cb]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcb043b3-944f-4682-ad99-77e84bcd26fb_igsfm07c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:12 devstack sudo[99624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcb043b3-944f-4682-ad99-77e84bcd26fb_igsfm07c
Nov 05 18:43:12 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:12 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db" returned: 0 in 0.474s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:12 devstack sudo[99630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db
Nov 05 18:43:12 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:12 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcb043b3-944f-4682-ad99-77e84bcd26fb_igsfm07c" returned: 0 in 0.399s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcb043b3-944f-4682-ad99-77e84bcd26fb_igsfm07c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:12 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-93ee7acf-e952-440a-96ec-dd727f2296db" returned: 0 in 0.281s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Lock "cinder-quobyte-93ee7acf-e952-440a-96ec-dd727f2296db" released by "delete_volume" :: held 0.824s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Flow 'volume_create_manager' (578791b5-a794-42d2-af2c-948d9ea97a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8b7c72-b5d0-4a48-b2a7-d3c4954d6d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8b7c72-b5d0-4a48-b2a7-d3c4954d6d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1434445918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d163ffff-53c7-4fcb-82e7-6d499a7e544e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0306097f68940f188a5e4bba16d7801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:43:12Z,use_quota=True,user_id='afe9d534df534b288d3250e302a56178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54afbcf6-39e9-4edf-a7c6-b91b8d1b36d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:12 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcb043b3-944f-4682-ad99-77e84bcd26fb_igsfm07c
Nov 05 18:43:12 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54afbcf6-39e9-4edf-a7c6-b91b8d1b36d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea10ecf-21ac-464f-94b3-cccdead0323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea10ecf-21ac-464f-94b3-cccdead0323a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd163ffff-53c7-4fcb-82e7-6d499a7e544e', 'volume_name': 'volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a28decb-fb72-4d82-b99e-d5f3411697ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a28decb-fb72-4d82-b99e-d5f3411697ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4ebdc0-580c-4d6c-89fa-8bf2dccaef8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:12 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Volume d163ffff-53c7-4fcb-82e7-6d499a7e544e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e', 'volume_size': 1}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1434445918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d163ffff-53c7-4fcb-82e7-6d499a7e544e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0306097f68940f188a5e4bba16d7801',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:43:12Z,use_quota=True,user_id='afe9d534df534b288d3250e302a56178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Creating volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:43:12 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:12 devstack sudo[99637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e 1073741824
Nov 05 18:43:12 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Created reservations ['241ed8dc-229a-49a2-aac5-8c31db44e3fa'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:12 devstack cinder-volume[87086]: WARNING cinder.quota [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-602652624 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-602652624, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:43:12 devstack cinder-volume[87086]: WARNING cinder.quota [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-602652624 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-602652624, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Created reservations ['f0c8f008-3628-41dd-a4c5-81d8da7639c0', '080cb872-c30c-4249-ab34-c8000b5a2a26', 'c16a132e-d509-4be5-a499-3c8e296a555f', '466f3f73-c7fc-455a-8f60-d9b3f265bb44'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:12 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcb043b3-944f-4682-ad99-77e84bcd26fb_igsfm07c" returned: 1 in 0.332s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcb043b3-944f-4682-ad99-77e84bcd26fb_igsfm07c' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b567c2ae-7fac-429e-98d8-de4a74705780]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:12 devstack sudo[99641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD
Nov 05 18:43:12 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:12 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:43:12 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:13 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e 1073741824" returned: 0 in 0.496s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:13 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:13 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:13 devstack sudo[99652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e
Nov 05 18:43:13 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.275s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:43:13 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-facd7082-9030-4359-9196-356f29d91a42 tempest-GroupsV314Test-2079085841 None] Delete group completed successfully.
Nov 05 18:43:13 devstack sudo[99654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD
Nov 05 18:43:13 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:13 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e" returned: 0 in 0.250s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4ebdc0-580c-4d6c-89fa-8bf2dccaef8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8ee8cc-0acb-4908-aeaf-755865dc3337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:13 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Volume volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e (d163ffff-53c7-4fcb-82e7-6d499a7e544e): created successfully
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8ee8cc-0acb-4908-aeaf-755865dc3337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Flow 'volume_create_manager' (578791b5-a794-42d2-af2c-948d9ea97a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:43:13 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-bc19190f-83e9-4fbe-b7c1-4e42441fa25b tempest-SnapshotsActionsTest-1946001034 None] Created volume successfully.
Nov 05 18:43:13 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] dcb043b3-944f-4682-ad99-77e84bcd26fb was raw, converting to qcow2 {{(pid=87086) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:13 devstack sudo[99660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1
Nov 05 18:43:13 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:13 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1" returned: 0 in 0.450s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dcb043b3-944f-4682-ad99-77e84bcd26fb_3_l103nrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:43:13 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 18:43:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:14 devstack sudo[99666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 1G
Nov 05 18:43:14 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Acquiring lock "cinder-quobyte-21e65bb2-4f36-4edf-be9a-4919e26a3e4f" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Lock "cinder-quobyte-21e65bb2-4f36-4edf-be9a-4919e26a3e4f" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbb9c3b-08f3-4633-9d75-148e7689bc8a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:14 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 1G" returned: 0 in 0.354s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Downloaded image dcb043b3-944f-4682-ad99-77e84bcd26fb ((None, [{'url': 'file:///opt/stack/data/glance/images/dcb043b3-944f-4682-ad99-77e84bcd26fb', 'metadata': {}}])) to volume 6c9937eb-6952-4915-902d-4dcb5076bdf1 successfully. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Temporary image dcb043b3-944f-4682-ad99-77e84bcd26fb for user 7a60f5cce58c4d71bc3ed00883518669 is deleted. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Marking volume 6c9937eb-6952-4915-902d-4dcb5076bdf1 as bootable. {{(pid=87086) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Copying metadata from image dcb043b3-944f-4682-ad99-77e84bcd26fb to 6c9937eb-6952-4915-902d-4dcb5076bdf1. {{(pid=87086) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Creating volume glance metadata for volume 6c9937eb-6952-4915-902d-4dcb5076bdf1 backed by image dcb043b3-944f-4682-ad99-77e84bcd26fb with: {'image_id': 'dcb043b3-944f-4682-ad99-77e84bcd26fb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '787841f1576c62482c7ae95748804b95', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87086) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 18:43:14 devstack sudo[99671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f
Nov 05 18:43:14 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f479b9aa-061a-4fa2-9951-7fe844331b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c9937eb-6952-4915-902d-4dcb5076bdf1', 'volume_size': 1, 'image_id': 'dcb043b3-944f-4682-ad99-77e84bcd26fb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcb043b3-944f-4682-ad99-77e84bcd26fb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '787841f1576c62482c7ae95748804b95', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23969f1141664f9c90080f002ba5a21f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ddd877d92ca7c12be4b3d85e090c9b985eadbb6fb064d7b65e25f7407930afd515397b71b042fa0a2fe577e9c03dd4964e0a7b5063b48aa781a7a761beff109', 'id': 'dcb043b3-944f-4682-ad99-77e84bcd26fb', 'created_at': datetime.datetime(2026, 11, 5, 17, 43, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 43, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcb043b3-944f-4682-ad99-77e84bcd26fb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea3be2d0>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4d19ce-030c-4770-af16-fea5ca9bd990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:14 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Volume volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 (6c9937eb-6952-4915-902d-4dcb5076bdf1): created successfully
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4d19ce-030c-4770-af16-fea5ca9bd990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Flow 'volume_create_manager' (46af7a71-b456-4518-881e-6aa5a1327be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:43:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c8f11ada-ace9-497d-970f-4156219b2370 tempest-VolumeImageDependencyTests-1438603865 None] Created volume successfully.
Nov 05 18:43:14 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f" returned: 0 in 0.388s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:14 devstack sudo[99676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f
Nov 05 18:43:14 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Creating offline snapshot db97e058-d5fe-41dc-bc4f-6f7374f63150 of volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfea503-e81e-41d8-a526-73f8a984fde1]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:14 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-21e65bb2-4f36-4edf-be9a-4919e26a3e4f" returned: 0 in 0.284s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Lock "cinder-quobyte-21e65bb2-4f36-4edf-be9a-4919e26a3e4f" released by "delete_volume" :: held 0.751s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:15 devstack sudo[99678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e
Nov 05 18:43:15 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Acquiring lock "cinder-6c9937eb-6952-4915-902d-4dcb5076bdf1-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Created reservations ['09f30aea-0694-4199-99f3-8e66df8cc7aa'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Lock "cinder-6c9937eb-6952-4915-902d-4dcb5076bdf1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Acquiring lock "cinder-quobyte-6c9937eb-6952-4915-902d-4dcb5076bdf1" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Created reservations ['79cf00ee-121d-4a9d-8bae-8652fad1d204', 'b82b802a-5745-409d-bf94-35d9737d8cef', 'ad71c344-1191-4a9a-a42c-d7cce27685e4', '715e7150-73c0-41a9-ba68-0ea271ee36cc'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Lock "cinder-quobyte-6c9937eb-6952-4915-902d-4dcb5076bdf1" acquired by "delete_volume" :: waited 0.035s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edc996e-2a86-4916-a692-017e691452fc]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:15 devstack sudo[99682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1
Nov 05 18:43:15 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:15 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e" returned: 0 in 0.542s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:15 devstack sudo[99686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:43:15 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:15 devstack sudo[99688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 1G
Nov 05 18:43:15 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:15 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.401s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:43:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d8d07ee9-8e4e-4b89-a268-ef3bac898e40 tempest-GroupsV314Test-2079085841 None] Delete group completed successfully.
Nov 05 18:43:15 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1" returned: 0 in 0.616s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:15 devstack sudo[99698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1
Nov 05 18:43:15 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:16 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 1G" returned: 0 in 0.681s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:16 devstack sudo[99701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:16 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:16 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6c9937eb-6952-4915-902d-4dcb5076bdf1" returned: 0 in 0.403s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Lock "cinder-quobyte-6c9937eb-6952-4915-902d-4dcb5076bdf1" released by "delete_volume" :: held 1.100s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Created reservations ['e144e41b-370a-4a85-b1da-046ed4f0369e', '407be73e-bd25-403e-8a0f-8beca79aa9c2', '8a68793a-0ee3-41cf-8b4e-bc9f6f8eee54', '0d1a7bcd-42d0-453b-a31a-82a83b656c93'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:16 devstack sudo[99707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:43:16 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:16 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:16 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 is being set with open permissions: ugo+rw
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:16 devstack sudo[99709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:16 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:16 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.291s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:43:16 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Deleted volume successfully.
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5cdda89d-b6c4-4136-8904-6b9cdabe9f20 tempest-VolumeImageDependencyTests-1438603865 None] Lock "cinder-6c9937eb-6952-4915-902d-4dcb5076bdf1-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:16 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.292s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:16 devstack sudo[99713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.info
Nov 05 18:43:16 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:17 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.info" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:17 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.info is being set with open permissions: ugo+rw
Nov 05 18:43:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:17 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.info
Nov 05 18:43:17 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:17 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.info" returned: 0 in 0.344s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.720s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:17 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ba9fcc9b-1d66-45ce-ba44-24649135d97c tempest-SnapshotsActionsTest-1946001034 None] Create snapshot completed successfully
Nov 05 18:43:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] Creating offline snapshot f340a266-2750-443b-9d6a-fbcb8c3445ea of volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:43:18 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[386cba49-c35a-4b0d-9ef5-fc9534ba3174]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:19 devstack sudo[99735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:19 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:19 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.527s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:19 devstack sudo[99741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea 1G
Nov 05 18:43:19 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:20 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea 1G" returned: 0 in 0.704s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:20 devstack sudo[99750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea
Nov 05 18:43:20 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:20 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea" returned: 0 in 0.369s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:20 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea is being set with open permissions: ugo+rw
Nov 05 18:43:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:20 devstack sudo[99755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea
Nov 05 18:43:20 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:20 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea" returned: 0 in 0.398s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-079c48a5-6e6f-4d43-9eee-fcc6c52e5010 tempest-SnapshotsActionsTest-1946001034 None] Create snapshot completed successfully
Nov 05 18:43:22 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-ba50582e-655e-4b98-a82d-ac355846b1de req-6fae7dac-b887-4a0e-a1e9-6373cfec040f tempest-TestShelveInstance-2027199727 None] Terminate volume connection completed successfully.
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-ba50582e-655e-4b98-a82d-ac355846b1de req-6fae7dac-b887-4a0e-a1e9-6373cfec040f tempest-TestShelveInstance-2027199727 None] Deleting attachment 2eebc05c-2a7a-4b48-b186-e8b49dbe7948. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-f340a266-2750-443b-9d6a-fbcb8c3445ea-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-f340a266-2750-443b-9d6a-fbcb8c3445ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-quobyte-f340a266-2750-443b-9d6a-fbcb8c3445ea" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-f340a266-2750-443b-9d6a-fbcb8c3445ea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Deleting offline snapshot f340a266-2750-443b-9d6a-fbcb8c3445ea of volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] snapshot_file for this snap is: volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc40398-f501-469e-938a-9a6e569b14ed]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:22 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea
Nov 05 18:43:22 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:23 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea" returned: 0 in 0.506s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:23 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[075f1956-1161-4dd2-8693-4d7c92355e52]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:23 devstack sudo[99783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:23 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:23 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.461s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:23 devstack sudo[99790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea
Nov 05 18:43:23 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:24 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea" returned: 0 in 0.533s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:24 devstack sudo[99795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea
Nov 05 18:43:24 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:24 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.f340a266-2750-443b-9d6a-fbcb8c3445ea" returned: 0 in 0.288s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-f340a266-2750-443b-9d6a-fbcb8c3445ea" released by "_delete_snapshot" :: held 1.945s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" released by "delete_snapshot" :: held 1.975s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Created reservations ['f0cc700f-0061-40a5-a0cb-deee4ab30395', 'a301ed6b-11c9-4668-8933-848b9e07a5bf', '6c1687a2-b7d4-4630-9fc1-a27323969983', '1c079bf6-a4da-48b8-9e51-081538f856bb'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Delete snapshot completed successfully.
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-606c981a-1ea0-437f-a6e3-8aca956a8073 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-f340a266-2750-443b-9d6a-fbcb8c3445ea-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-17f58550-1167-4043-b90b-53fd2286879d req-5ba121e7-9d8e-4cae-8a60-774e42535456 tempest-TestShelveInstance-2027199727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-17f58550-1167-4043-b90b-53fd2286879d req-5ba121e7-9d8e-4cae-8a60-774e42535456 tempest-TestShelveInstance-2027199727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-17f58550-1167-4043-b90b-53fd2286879d req-5ba121e7-9d8e-4cae-8a60-774e42535456 tempest-TestShelveInstance-2027199727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-17f58550-1167-4043-b90b-53fd2286879d req-5ba121e7-9d8e-4cae-8a60-774e42535456 tempest-TestShelveInstance-2027199727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-6a286e25-0c59-4b42-8caa-010d177b0a3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f88c37a-7d1f-4826-986e-83f75fba5519', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:43:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-17f58550-1167-4043-b90b-53fd2286879d req-5ba121e7-9d8e-4cae-8a60-774e42535456 tempest-TestShelveInstance-2027199727 None] attachment_update completed successfully.
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] Creating offline snapshot fe271d65-d41e-4aba-8d14-7572622f49c0 of volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb4a18c-b132-45bc-bb53-bdc8a9e01ed1]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:25 devstack sudo[99807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:25 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:25 devstack sudo[99809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:43:25 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:25 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.593s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:25 devstack sudo[99814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0 1G
Nov 05 18:43:25 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:26 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.399s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:43:26 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:43:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:43:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:43:26 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0 1G" returned: 0 in 0.652s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:26 devstack sudo[99821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0
Nov 05 18:43:26 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:26 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0" returned: 0 in 0.339s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:26 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0 is being set with open permissions: ugo+rw
Nov 05 18:43:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:26 devstack sudo[99828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0
Nov 05 18:43:26 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:27 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0" returned: 0 in 0.304s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:27 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1b7eba33-77f8-4caf-9c88-2ecf4837cb4f tempest-SnapshotsActionsTest-1946001034 None] Create snapshot completed successfully
Nov 05 18:43:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-fe271d65-d41e-4aba-8d14-7572622f49c0-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-fe271d65-d41e-4aba-8d14-7572622f49c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-quobyte-fe271d65-d41e-4aba-8d14-7572622f49c0" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-fe271d65-d41e-4aba-8d14-7572622f49c0" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Deleting offline snapshot fe271d65-d41e-4aba-8d14-7572622f49c0 of volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:43:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] snapshot_file for this snap is: volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:43:28 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e93bf8-9409-4c24-bcfd-bbb558bf42a3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:29 devstack sudo[100287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0
Nov 05 18:43:29 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:29 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0" returned: 0 in 0.763s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:29 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1e621b-24c1-43e0-8996-cb8eb66fff9b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:29 devstack sudo[100316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:29 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:30 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.748s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:30 devstack sudo[100323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0
Nov 05 18:43:30 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:30 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0" returned: 0 in 0.525s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:30 devstack sudo[100329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0
Nov 05 18:43:30 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:31 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.fe271d65-d41e-4aba-8d14-7572622f49c0" returned: 0 in 0.332s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-fe271d65-d41e-4aba-8d14-7572622f49c0" released by "_delete_snapshot" :: held 2.547s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" released by "delete_snapshot" :: held 2.601s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:31 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Created reservations ['92235bb9-0edf-4dee-bd2e-338a1f0aedc2', '035c19bf-d9a8-4adc-8736-433178970f61', '10db4e44-37ef-44e6-9297-49c09c2d3753', 'c25bc092-c4c6-4485-b322-665e7e09f917'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:31 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Delete snapshot completed successfully.
Nov 05 18:43:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-aac361a6-e2a6-4ae0-b591-60e36a792571 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-fe271d65-d41e-4aba-8d14-7572622f49c0-delete_snapshot" released by "delete_snapshot" :: held 2.911s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] Creating offline snapshot 4981fc4f-4bd1-4afa-a3ed-dc940db04c3a of volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:43:32 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d45197-54ab-48c5-9fed-8c7be94621d9]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:32 devstack sudo[100332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:32 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:33 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.529s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:33 devstack sudo[100342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a 1G
Nov 05 18:43:33 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:33 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a 1G" returned: 0 in 0.570s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:33 devstack sudo[100348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a
Nov 05 18:43:33 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:34 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a" returned: 0 in 0.373s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:34 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a is being set with open permissions: ugo+rw
Nov 05 18:43:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:34 devstack sudo[100354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a
Nov 05 18:43:34 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:34 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a" returned: 0 in 0.388s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:34 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7a042920-f040-4cb6-a41a-94ade88fe7ac tempest-SnapshotsActionsTest-1946001034 None] Create snapshot completed successfully
Nov 05 18:43:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-4981fc4f-4bd1-4afa-a3ed-dc940db04c3a-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-4981fc4f-4bd1-4afa-a3ed-dc940db04c3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-quobyte-4981fc4f-4bd1-4afa-a3ed-dc940db04c3a" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-4981fc4f-4bd1-4afa-a3ed-dc940db04c3a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Deleting offline snapshot 4981fc4f-4bd1-4afa-a3ed-dc940db04c3a of volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:43:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] snapshot_file for this snap is: volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:43:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e41546b-3db1-415d-869c-9509c9dd3583]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:36 devstack sudo[100360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a
Nov 05 18:43:36 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:36 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a" returned: 0 in 0.454s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:36 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27afada-5bec-4f98-8714-e1b8a33637b6]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:36 devstack sudo[100365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:36 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:36 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.398s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:36 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a
Nov 05 18:43:36 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:37 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a" returned: 0 in 0.424s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:37 devstack sudo[100379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a
Nov 05 18:43:37 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:37 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.4981fc4f-4bd1-4afa-a3ed-dc940db04c3a" returned: 0 in 0.266s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-4981fc4f-4bd1-4afa-a3ed-dc940db04c3a" released by "_delete_snapshot" :: held 1.691s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" released by "delete_snapshot" :: held 1.723s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:37 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Created reservations ['f53268f3-402a-4cd3-abed-9fdca2288c43', '731ac816-61f7-44e9-b82c-24069e627735', 'be40da7f-00e3-434f-8a4b-f27bf000f620', 'a24fd939-53c4-4145-9f26-73e6d0aff4f1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:37 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Delete snapshot completed successfully.
Nov 05 18:43:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f02bd35e-5943-43e2-823e-ebc5e47662f0 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-4981fc4f-4bd1-4afa-a3ed-dc940db04c3a-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] Creating offline snapshot 83a9da3e-5e05-4e3c-a4f2-3edc64808b7d of volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Flow 'volume_create_manager' (bd2d1edc-4c2b-4dc9-b42f-1170f3c9f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5302c1df-c7a9-40f5-9d22-98125d1114ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa9c1f9-1670-4f94-a530-712946083da2]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5302c1df-c7a9-40f5-9d22-98125d1114ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1057052284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=056ce13b-fc4c-48d0-b0d1-4deba113f3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02974126381b41e58a39af449543b26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:43:38Z,use_quota=True,user_id='11a59e795d7a4c7a847696e1927018e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1524b60d-62b0-4759-b614-4e0bb44b93cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1524b60d-62b0-4759-b614-4e0bb44b93cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a9a43d-a4ee-4d71-bd75-184feb8e6048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a9a43d-a4ee-4d71-bd75-184feb8e6048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '056ce13b-fc4c-48d0-b0d1-4deba113f3a0', 'volume_name': 'volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5341f21c-fd74-4092-ba53-e3961bc89466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5341f21c-fd74-4092-ba53-e3961bc89466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77298609-c11a-4ed2-9666-8011eff5f468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:38 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Volume 056ce13b-fc4c-48d0-b0d1-4deba113f3a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0', 'volume_size': 1}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:38 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:38 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:38 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.369s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:38 devstack sudo[100388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d 1G
Nov 05 18:43:38 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:39 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d 1G" returned: 0 in 0.428s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:39 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d
Nov 05 18:43:39 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:39 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d" returned: 0 in 0.274s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:39 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d is being set with open permissions: ugo+rw
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:39 devstack sudo[100398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d
Nov 05 18:43:39 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:39 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d" returned: 0 in 0.253s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.452s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.302s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1057052284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=056ce13b-fc4c-48d0-b0d1-4deba113f3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02974126381b41e58a39af449543b26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:43:38Z,use_quota=True,user_id='11a59e795d7a4c7a847696e1927018e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Creating volume 056ce13b-fc4c-48d0-b0d1-4deba113f3a0 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:43:39 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:43:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:39 devstack sudo[100401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0 1073741824
Nov 05 18:43:39 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3ba1f678-3cb6-4353-b4a2-e973fb7cd9d9 tempest-SnapshotsActionsTest-1946001034 None] Create snapshot completed successfully
Nov 05 18:43:40 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0 1073741824" returned: 0 in 0.415s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:40 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0
Nov 05 18:43:40 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-83a9da3e-5e05-4e3c-a4f2-3edc64808b7d-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-83a9da3e-5e05-4e3c-a4f2-3edc64808b7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Acquiring lock "cinder-quobyte-83a9da3e-5e05-4e3c-a4f2-3edc64808b7d" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-83a9da3e-5e05-4e3c-a4f2-3edc64808b7d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Deleting offline snapshot 83a9da3e-5e05-4e3c-a4f2-3edc64808b7d of volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:43:40 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] snapshot_file for this snap is: volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c019b0-635e-48ff-922c-ae52ed671a8c]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77298609-c11a-4ed2-9666-8011eff5f468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acec79c9-2dd7-442b-bba5-b5d988580458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:40 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Volume volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0 (056ce13b-fc4c-48d0-b0d1-4deba113f3a0): created successfully
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acec79c9-2dd7-442b-bba5-b5d988580458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Flow 'volume_create_manager' (bd2d1edc-4c2b-4dc9-b42f-1170f3c9f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:43:40 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9e43a4e0-5b3c-499d-8065-a99e5b3962eb tempest-VolumeQuotasAdminTestJSON-1831500616 None] Created volume successfully.
Nov 05 18:43:40 devstack sudo[100409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d
Nov 05 18:43:40 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:41 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d" returned: 0 in 0.365s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6da8e4-8f5e-4fc3-abb5-d49a1d8b8065]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:41 devstack sudo[100414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:41 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:41 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.347s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:41 devstack sudo[100419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d
Nov 05 18:43:41 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Acquiring lock "cinder-056ce13b-fc4c-48d0-b0d1-4deba113f3a0-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "cinder-056ce13b-fc4c-48d0-b0d1-4deba113f3a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Acquiring lock "cinder-quobyte-056ce13b-fc4c-48d0-b0d1-4deba113f3a0" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "cinder-quobyte-056ce13b-fc4c-48d0-b0d1-4deba113f3a0" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee002277-aa7a-4be5-9ddb-e0d72c25a7e5]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:41 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d" returned: 0 in 0.428s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:41 devstack sudo[100425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d
Nov 05 18:43:41 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:41 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0
Nov 05 18:43:41 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:42 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.83a9da3e-5e05-4e3c-a4f2-3edc64808b7d" returned: 0 in 0.261s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:42 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0" returned: 0 in 0.384s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-83a9da3e-5e05-4e3c-a4f2-3edc64808b7d" released by "_delete_snapshot" :: held 1.522s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" released by "delete_snapshot" :: held 1.559s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:42 devstack sudo[100432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0
Nov 05 18:43:42 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Created reservations ['d8e4d273-4a8f-4346-8d1b-28a3ff0409d7', '93931a1f-162a-465e-a6b9-8b03beb3ebdb', '9623ea6e-6b50-4d36-9b61-989281fc5fa1', '3cefc3db-7ec0-4ae6-9205-6a4dc31742a6'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:42 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Delete snapshot completed successfully.
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fb8c83f-7fa9-4f02-bb8d-b4e642d37472 tempest-SnapshotsActionsTest-801184535 None] Lock "cinder-83a9da3e-5e05-4e3c-a4f2-3edc64808b7d-delete_snapshot" released by "delete_snapshot" :: held 1.732s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:42 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-056ce13b-fc4c-48d0-b0d1-4deba113f3a0" returned: 0 in 0.268s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "cinder-quobyte-056ce13b-fc4c-48d0-b0d1-4deba113f3a0" released by "delete_volume" :: held 0.695s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Created reservations ['00388662-13c5-4a39-9247-516f61046b5e', 'ab325192-90cf-48c9-9d1c-4690acfb60d7', 'e5eb1d1d-75b4-4ada-8947-b74a139832c9', '4d01caa7-0bbe-4f06-ada6-ff873c1eec6b'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:42 devstack sudo[100435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:43:42 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:42 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.320s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:43:42 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Deleted volume successfully.
Nov 05 18:43:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d591da16-eb75-4ca3-9026-9e69ae9208e5 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "cinder-056ce13b-fc4c-48d0-b0d1-4deba113f3a0-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "cinder-db97e058-d5fe-41dc-bc4f-6f7374f63150-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Lock "cinder-db97e058-d5fe-41dc-bc4f-6f7374f63150-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "cinder-quobyte-db97e058-d5fe-41dc-bc4f-6f7374f63150" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Lock "cinder-quobyte-db97e058-d5fe-41dc-bc4f-6f7374f63150" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Deleting offline snapshot db97e058-d5fe-41dc-bc4f-6f7374f63150 of volume d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] snapshot_file for this snap is: volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edb313e-1998-418d-b2dc-8a8e56a4be7d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Flow 'volume_create_manager' (6495841f-e3fa-45d1-9511-d84bbd5e5a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6a3030-e160-4470-abd5-f1b3cf7386b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6a3030-e160-4470-abd5-f1b3cf7386b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1074285612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420b190d-4848-4018-9635-890d75478ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02974126381b41e58a39af449543b26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:43:43Z,use_quota=True,user_id='11a59e795d7a4c7a847696e1927018e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d053499d-7fe3-441c-b2ed-a073ba12ef45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d053499d-7fe3-441c-b2ed-a073ba12ef45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c149cd1-11f5-486a-bec9-0cc16b6e3ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c149cd1-11f5-486a-bec9-0cc16b6e3ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420b190d-4848-4018-9635-890d75478ad1', 'volume_name': 'volume-420b190d-4848-4018-9635-890d75478ad1', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51026802-e3e7-4f1f-b4ae-328cd75e5754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51026802-e3e7-4f1f-b4ae-328cd75e5754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf78b064-e154-4107-a09f-f5397b39e42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:43 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Volume 420b190d-4848-4018-9635-890d75478ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420b190d-4848-4018-9635-890d75478ad1', 'volume_size': 1}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1074285612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420b190d-4848-4018-9635-890d75478ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02974126381b41e58a39af449543b26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:43:43Z,use_quota=True,user_id='11a59e795d7a4c7a847696e1927018e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Creating volume 420b190d-4848-4018-9635-890d75478ad1 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:43:43 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:43 devstack sudo[100438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:43 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:43 devstack sudo[100439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1 1073741824
Nov 05 18:43:43 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:43 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.411s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e64319-8bf6-43df-8c10-57a0877a1fda]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:44 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1 1073741824" returned: 0 in 0.487s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:44 devstack sudo[100448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e
Nov 05 18:43:44 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:44 devstack sudo[100450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1
Nov 05 18:43:44 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:44 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e" returned: 0 in 0.446s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:44 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1" returned: 0 in 0.277s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:44 devstack sudo[100456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:44 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf78b064-e154-4107-a09f-f5397b39e42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420b190d-4848-4018-9635-890d75478ad1', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d4b126-b2ce-4b1b-9c3b-29869f8451c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:44 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Volume volume-420b190d-4848-4018-9635-890d75478ad1 (420b190d-4848-4018-9635-890d75478ad1): created successfully
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d4b126-b2ce-4b1b-9c3b-29869f8451c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Flow 'volume_create_manager' (6495841f-e3fa-45d1-9511-d84bbd5e5a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:43:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8a74496e-0c0c-4822-9d0e-636bcf654ac9 tempest-VolumeQuotasAdminTestJSON-1831500616 None] Created volume successfully.
Nov 05 18:43:44 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.342s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:44 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150
Nov 05 18:43:44 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:44 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e.db97e058-d5fe-41dc-bc4f-6f7374f63150" returned: 0 in 0.242s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Lock "cinder-quobyte-db97e058-d5fe-41dc-bc4f-6f7374f63150" released by "_delete_snapshot" :: held 1.585s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" released by "delete_snapshot" :: held 1.618s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:45 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Created reservations ['add8728b-1bbc-4b57-9f53-8c77a3e638f8', '5670290d-fee2-49e9-8572-b012a4f61e71', '6a08b21f-d574-412f-a2fd-bc14fa5dc50e', '70d2d7b1-c01c-4617-a60d-a43cbed22081'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Delete snapshot completed successfully.
Nov 05 18:43:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9680fe2c-12ae-4c93-a3b9-eb8974b48eab tempest-SnapshotsActionsTest-1946001034 None] Lock "cinder-db97e058-d5fe-41dc-bc4f-6f7374f63150-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "cinder-d163ffff-53c7-4fcb-82e7-6d499a7e544e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Lock "cinder-d163ffff-53c7-4fcb-82e7-6d499a7e544e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:45 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b87825-0f3d-46c4-a094-6340adb1a6dd]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:45 devstack sudo[100485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e
Nov 05 18:43:45 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:46 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e" returned: 0 in 0.430s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:46 devstack sudo[100490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e
Nov 05 18:43:46 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7f44b4ce-c651-4dbb-94f5-1187277ac2a3 tempest-VolumeQuotasAdminTestJSON-1075207318 None] Transfer volume completed successfully.
Nov 05 18:43:46 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d163ffff-53c7-4fcb-82e7-6d499a7e544e" returned: 0 in 0.433s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Lock "cinder-quobyte-d163ffff-53c7-4fcb-82e7-6d499a7e544e" released by "delete_volume" :: held 0.948s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Created reservations ['58b63ab7-4c6c-409a-9dfe-807d4acaaf12', '1191a61d-9796-4261-ac2d-3a968b1cd521', '6bebb7e9-46a1-4ec6-bef4-e5d8feae32fe', '4d361712-2960-4956-967a-b671aefd5c19'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:46 devstack sudo[100529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:43:46 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Acquiring lock "cinder-420b190d-4848-4018-9635-890d75478ad1-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Lock "cinder-420b190d-4848-4018-9635-890d75478ad1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Acquiring lock "cinder-quobyte-420b190d-4848-4018-9635-890d75478ad1" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Lock "cinder-quobyte-420b190d-4848-4018-9635-890d75478ad1" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc7e9a1-dcb7-4f74-b3dc-fd36e72f498d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:47 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:43:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Deleted volume successfully.
Nov 05 18:43:47 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1
Nov 05 18:43:47 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f47a20a2-2c42-4bd4-8cb7-0a751fe78c42 tempest-SnapshotsActionsTest-1946001034 None] Lock "cinder-d163ffff-53c7-4fcb-82e7-6d499a7e544e-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:47 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1" returned: 0 in 0.374s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:47 devstack sudo[100537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1
Nov 05 18:43:47 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:47 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-420b190d-4848-4018-9635-890d75478ad1" returned: 0 in 0.250s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Lock "cinder-quobyte-420b190d-4848-4018-9635-890d75478ad1" released by "delete_volume" :: held 0.661s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Created reservations ['19cbc29d-ba64-446f-a095-1febaff6e375', 'ca7cf913-deb6-4641-b9cb-90b12b3efa22', '04569fea-bbae-4261-ab0b-35ca8e90505e', 'fe72584c-2fc0-42f3-9263-ae9e602459e7'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:47 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:43:47 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:48 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.284s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:48 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:43:48 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Deleted volume successfully.
Nov 05 18:43:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-994c658d-f523-4b41-9051-8cd0ec929992 tempest-VolumeQuotasAdminTestJSON-1191801477 None] Lock "cinder-420b190d-4848-4018-9635-890d75478ad1-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Flow 'volume_create_manager' (01b93efe-1150-407f-9320-29f98b926e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b3b825-b676-4201-aa06-b650b4b24a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b3b825-b676-4201-aa06-b650b4b24a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1464354290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766db2c1-8544-4c50-949f-a1cce68d6d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0ebd86e0374cabacdddfc3e0bc477d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:43:55Z,use_quota=True,user_id='108192db31644bb19ac7439964263593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171dea58-aa2b-4050-8805-ce2d92d75153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171dea58-aa2b-4050-8805-ce2d92d75153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6974460e-90d8-4c36-a414-31ef09f44dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6974460e-90d8-4c36-a414-31ef09f44dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766db2c1-8544-4c50-949f-a1cce68d6d43', 'volume_name': 'volume-766db2c1-8544-4c50-949f-a1cce68d6d43', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff872db-1bcd-44b1-9c83-710371dc13ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff872db-1bcd-44b1-9c83-710371dc13ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14dca431-5c31-4007-9ecc-2b364f46dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:55 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Volume 766db2c1-8544-4c50-949f-a1cce68d6d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766db2c1-8544-4c50-949f-a1cce68d6d43', 'volume_size': 1}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1464354290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766db2c1-8544-4c50-949f-a1cce68d6d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0ebd86e0374cabacdddfc3e0bc477d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:43:55Z,use_quota=True,user_id='108192db31644bb19ac7439964263593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Creating volume 766db2c1-8544-4c50-949f-a1cce68d6d43 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:43:55 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:55 devstack sudo[100571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43 1073741824
Nov 05 18:43:55 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:55 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43 1073741824" returned: 0 in 0.435s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:55 devstack sudo[100577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43
Nov 05 18:43:55 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:56 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43" returned: 0 in 0.246s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14dca431-5c31-4007-9ecc-2b364f46dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766db2c1-8544-4c50-949f-a1cce68d6d43', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2f9dfa-36f0-4506-9a97-7b5e45fe8143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:43:56 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Volume volume-766db2c1-8544-4c50-949f-a1cce68d6d43 (766db2c1-8544-4c50-949f-a1cce68d6d43): created successfully
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2f9dfa-36f0-4506-9a97-7b5e45fe8143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Flow 'volume_create_manager' (01b93efe-1150-407f-9320-29f98b926e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:43:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1d244ccf-462d-48df-8404-75c02a437b48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Created volume successfully.
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Creating offline snapshot 8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 of volume 766db2c1-8544-4c50-949f-a1cce68d6d43 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff01098c-b86f-46ba-8ae7-4618e69366f5]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:56 devstack sudo[100580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43
Nov 05 18:43:56 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:56 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43" returned: 0 in 0.388s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:56 devstack sudo[100585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 1G
Nov 05 18:43:56 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:57 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 1G" returned: 0 in 0.454s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-766db2c1-8544-4c50-949f-a1cce68d6d43 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:57 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-766db2c1-8544-4c50-949f-a1cce68d6d43 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9
Nov 05 18:43:57 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:57 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-766db2c1-8544-4c50-949f-a1cce68d6d43 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9" returned: 0 in 0.312s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:57 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 is being set with open permissions: ugo+rw
Nov 05 18:43:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:57 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9
Nov 05 18:43:57 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:57 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:58 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.info
Nov 05 18:43:58 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:58 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.info" returned: 0 in 0.253s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:58 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.info is being set with open permissions: ugo+rw
Nov 05 18:43:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:43:58 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.info
Nov 05 18:43:58 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:43:58 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Nov 05 18:43:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.info" returned: 0 in 0.267s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:43:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:43:58 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-dce90b3e-11c2-4a4b-a93d-269275172b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Create snapshot completed successfully
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Acquiring lock "cinder-8df51259-6dd2-4ce0-9983-e7c9b17fdcc9-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "cinder-8df51259-6dd2-4ce0-9983-e7c9b17fdcc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Acquiring lock "cinder-quobyte-766db2c1-8544-4c50-949f-a1cce68d6d43" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "cinder-quobyte-766db2c1-8544-4c50-949f-a1cce68d6d43" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Acquiring lock "cinder-quobyte-8df51259-6dd2-4ce0-9983-e7c9b17fdcc9" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "cinder-quobyte-8df51259-6dd2-4ce0-9983-e7c9b17fdcc9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Deleting offline snapshot 8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 of volume 766db2c1-8544-4c50-949f-a1cce68d6d43 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] snapshot_file for this snap is: volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0441b3-e969-4545-9d67-8affca1c5198]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:00 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9
Nov 05 18:44:00 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:00 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9" returned: 0 in 0.375s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-766db2c1-8544-4c50-949f-a1cce68d6d43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e7616d-1cc3-420a-b4fb-2b1a12c0f916]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:00 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43
Nov 05 18:44:00 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:00 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43" returned: 0 in 0.379s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:00 devstack sudo[100615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9
Nov 05 18:44:00 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:01 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9" returned: 0 in 0.348s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:01 devstack sudo[100621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9
Nov 05 18:44:01 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:01 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43.8df51259-6dd2-4ce0-9983-e7c9b17fdcc9" returned: 0 in 0.239s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "cinder-quobyte-8df51259-6dd2-4ce0-9983-e7c9b17fdcc9" released by "_delete_snapshot" :: held 1.468s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "cinder-quobyte-766db2c1-8544-4c50-949f-a1cce68d6d43" released by "delete_snapshot" :: held 1.491s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:01 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Created reservations ['55544bb2-4afb-4865-887a-bf70ab9520a8', '70a5c5fc-df17-4ab8-bc46-0aa79590b26a', 'ffb71933-6faf-481f-af1d-99ced03640fe', 'ec7072ae-614e-4dde-9946-a68889ccac2c'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:44:01 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Delete snapshot completed successfully.
Nov 05 18:44:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8a4732c3-ddf4-4742-9001-e3cace8baac4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "cinder-8df51259-6dd2-4ce0-9983-e7c9b17fdcc9-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Acquiring lock "cinder-766db2c1-8544-4c50-949f-a1cce68d6d43-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "cinder-766db2c1-8544-4c50-949f-a1cce68d6d43-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Acquiring lock "cinder-quobyte-766db2c1-8544-4c50-949f-a1cce68d6d43" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "cinder-quobyte-766db2c1-8544-4c50-949f-a1cce68d6d43" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:02 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[42efc474-1e9b-4b2e-ab9f-6eb09456d999]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:44:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:02 devstack sudo[100624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43
Nov 05 18:44:02 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:02 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43" returned: 0 in 0.384s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:02 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43
Nov 05 18:44:02 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:03 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-766db2c1-8544-4c50-949f-a1cce68d6d43" returned: 0 in 0.245s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "cinder-quobyte-766db2c1-8544-4c50-949f-a1cce68d6d43" released by "delete_volume" :: held 0.718s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Created reservations ['8f95a423-7e0f-4d3b-8209-dda5c0b42aee', '58a2cc6e-d233-46df-9a46-629958979bf4', 'd48a23cf-ce08-41a9-8bd8-ab4ea4a1873a', '1c0d8c3a-e83e-4f9d-9223-85c54737ad14'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:03 devstack sudo[100632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:44:03 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:03 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.254s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:44:03 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Deleted volume successfully.
Nov 05 18:44:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7c859cf0-14ac-4ba1-a97f-04e742eb200a tempest-VolumeSnapshotQuotasNegativeTestJSON-1762964620 None] Lock "cinder-766db2c1-8544-4c50-949f-a1cce68d6d43-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=127,cinder:SELECT=121,cinder:INSERT=30,cinder:DELETE=5 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=120,cinder:SELECT=106,cinder:INSERT=40,cinder:DELETE=11 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Flow 'volume_create_manager' (35b6935c-c472-4f48-a412-f34ba318181d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05435547-805c-4531-a0bf-3ed0c23af1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05435547-805c-4531-a0bf-3ed0c23af1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2010784734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4525f1f4-ed08-4bbf-bb40-7f4da517a8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c72b0be0c6404289e855000f16a869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:11Z,use_quota=True,user_id='71c7a74a84944750b4752d269886dd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(975585f1-78c1-45e8-8cea-fe30f286fe18),volume_type_id=975585f1-78c1-45e8-8cea-fe30f286fe18)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6883d2d-4d1d-489b-a0f3-f948f585ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6883d2d-4d1d-489b-a0f3-f948f585ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d6628a-45f6-4ada-a6df-cca3e0ea634b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d6628a-45f6-4ada-a6df-cca3e0ea634b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4525f1f4-ed08-4bbf-bb40-7f4da517a8ad', 'volume_name': 'volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb56673d-dc3e-4bd9-93a1-ba99a1d4012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb56673d-dc3e-4bd9-93a1-ba99a1d4012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbd569f-f476-47c5-b9f9-612cac24ac02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:11 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Volume 4525f1f4-ed08-4bbf-bb40-7f4da517a8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad', 'volume_size': 1}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2010784734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4525f1f4-ed08-4bbf-bb40-7f4da517a8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c72b0be0c6404289e855000f16a869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:11Z,use_quota=True,user_id='71c7a74a84944750b4752d269886dd2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(975585f1-78c1-45e8-8cea-fe30f286fe18),volume_type_id=975585f1-78c1-45e8-8cea-fe30f286fe18)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Creating volume 4525f1f4-ed08-4bbf-bb40-7f4da517a8ad {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:44:11 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:11 devstack sudo[100667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad 1073741824
Nov 05 18:44:11 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:11 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-70cb966c-5ec0-4b30-bab4-3f7de4ff589d tempest-TestShelveInstance-2027199727 None] Terminate volume connection completed successfully.
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-70cb966c-5ec0-4b30-bab4-3f7de4ff589d tempest-TestShelveInstance-2027199727 None] Deleting attachment 6f88c37a-7d1f-4826-986e-83f75fba5519. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Acquiring lock "cinder-6a286e25-0c59-4b42-8caa-010d177b0a3f-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Lock "cinder-6a286e25-0c59-4b42-8caa-010d177b0a3f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Acquiring lock "cinder-quobyte-6a286e25-0c59-4b42-8caa-010d177b0a3f" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Lock "cinder-quobyte-6a286e25-0c59-4b42-8caa-010d177b0a3f" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[201c6103-cb95-44eb-8e1e-3c45964f3d6a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:44:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:11 devstack sudo[100672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f
Nov 05 18:44:11 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:12 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad 1073741824" returned: 0 in 0.744s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:12 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad
Nov 05 18:44:12 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:12 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f" returned: 0 in 0.592s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:12 devstack sudo[100679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f
Nov 05 18:44:12 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:12 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad" returned: 0 in 0.315s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cbd569f-f476-47c5-b9f9-612cac24ac02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb90fc85-60bd-4953-88b8-ddca1a9fa1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:12 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Volume volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad (4525f1f4-ed08-4bbf-bb40-7f4da517a8ad): created successfully
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb90fc85-60bd-4953-88b8-ddca1a9fa1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Flow 'volume_create_manager' (35b6935c-c472-4f48-a412-f34ba318181d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:12 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c23eff03-4d84-4997-8385-e62bde568e24 tempest-VolumeTypesAccessTest-1523618828 None] Created volume successfully.
Nov 05 18:44:12 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6a286e25-0c59-4b42-8caa-010d177b0a3f" returned: 0 in 0.324s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Lock "cinder-quobyte-6a286e25-0c59-4b42-8caa-010d177b0a3f" released by "delete_volume" :: held 0.989s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG cinder.quota [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Created reservations ['7aea8772-0ae7-45bf-a6c9-6d0cd63f4379', '0467c0d3-0cdf-4cbf-afe8-4a4c43f99aec', '05c71a32-61f5-4ee8-9c90-f022b9837e89', '3f1a50d5-c5e8-440e-866b-be94e0bb5e3e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:12 devstack sudo[100683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:44:12 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:13 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.450s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG cinder.manager [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:44:13 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Deleted volume successfully.
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [req-11f40fa6-a3fd-49e2-b21c-5f49e0910b91 req-7c41498e-a641-4365-82f1-c540918a9ff1 tempest-TestShelveInstance-2027199727 None] Lock "cinder-6a286e25-0c59-4b42-8caa-010d177b0a3f-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Acquiring lock "cinder-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Lock "cinder-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Acquiring lock "cinder-quobyte-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Lock "cinder-quobyte-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[be342516-d977-41a1-8ad3-b8e8c9b3b91a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:13 devstack sudo[100686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad
Nov 05 18:44:13 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:13 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad" returned: 0 in 0.439s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:13 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad
Nov 05 18:44:13 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:14 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad" returned: 0 in 0.264s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Lock "cinder-quobyte-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad" released by "delete_volume" :: held 0.754s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:14 devstack cinder-volume[87086]: WARNING cinder.quota [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2143191502 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2143191502, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:44:14 devstack cinder-volume[87086]: WARNING cinder.quota [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2143191502 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2143191502, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Created reservations ['0454d88f-4a99-4cf2-945e-f722dd7127b3', 'e9090a95-31df-4781-9060-54f4ec9a3984', '4020f9b1-c89f-403c-94e4-bb84bb0b2160', 'c130db90-c7e8-455d-b127-8f094a5df7f3'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:14 devstack sudo[100694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:44:14 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:14 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.318s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:44:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Deleted volume successfully.
Nov 05 18:44:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6dc4c624-9aeb-45d5-9576-c111b73fd9e9 tempest-VolumeTypesAccessTest-1523618828 None] Lock "cinder-4525f1f4-ed08-4bbf-bb40-7f4da517a8ad-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:24 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=11,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:44:24 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=14,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:25 devstack sudo[100703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:44:25 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:25 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.306s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:44:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:44:40 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (7bc0c873-7704-494a-aeb4-8b34fec12b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf29e19b-fa5f-41b7-98ff-efe07f27440f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf29e19b-fa5f-41b7-98ff-efe07f27440f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-848848265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81655d8c-7cf1-40f0-8145-82f0760c6da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:41Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c2ca13-4005-47ac-9ea1-e85a33678059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c2ca13-4005-47ac-9ea1-e85a33678059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a8a5ac-8615-49f7-8ee8-8fb6b5aa61fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a8a5ac-8615-49f7-8ee8-8fb6b5aa61fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81655d8c-7cf1-40f0-8145-82f0760c6da5', 'volume_name': 'volume-81655d8c-7cf1-40f0-8145-82f0760c6da5', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9ccbb5-246c-443c-b59a-f37002d9cd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9ccbb5-246c-443c-b59a-f37002d9cd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c86a875-d518-4024-9646-d286c9afd518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:41 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Volume 81655d8c-7cf1-40f0-8145-82f0760c6da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81655d8c-7cf1-40f0-8145-82f0760c6da5', 'volume_size': 1}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-848848265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81655d8c-7cf1-40f0-8145-82f0760c6da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:41Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Creating volume 81655d8c-7cf1-40f0-8145-82f0760c6da5 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:44:41 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:41 devstack sudo[100803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5 1073741824
Nov 05 18:44:41 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:41 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5 1073741824" returned: 0 in 0.642s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:42 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5
Nov 05 18:44:42 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:42 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5" returned: 0 in 0.387s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:44:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c86a875-d518-4024-9646-d286c9afd518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81655d8c-7cf1-40f0-8145-82f0760c6da5', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1dc6b7-09d2-41f0-a8c5-69bcb5446912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:42 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Volume volume-81655d8c-7cf1-40f0-8145-82f0760c6da5 (81655d8c-7cf1-40f0-8145-82f0760c6da5): created successfully
Nov 05 18:44:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1dc6b7-09d2-41f0-a8c5-69bcb5446912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (7bc0c873-7704-494a-aeb4-8b34fec12b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:42 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fb29bd00-5347-4b82-9e16-ac43dcf2b09e tempest-VolumesActionsTest-1076551861 None] Created volume successfully.
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4fc127fd-a704-4abb-9e99-3fa8b080e693 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5" by "attach_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4fc127fd-a704-4abb-9e99-3fa8b080e693 tempest-VolumesActionsTest-1076551861 None] Lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5" acquired by "attach_volume" :: waited 0.055s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-4fc127fd-a704-4abb-9e99-3fa8b080e693 tempest-VolumesActionsTest-1076551861 None] Attaching volume 81655d8c-7cf1-40f0-8145-82f0760c6da5 to instance 3d7a4fc3-9a73-4859-8f8a-fc2ba8064c4a at mountpoint /dev/vdb on host None.
Nov 05 18:44:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-4fc127fd-a704-4abb-9e99-3fa8b080e693 tempest-VolumesActionsTest-1076551861 None] Attach volume completed successfully.
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4fc127fd-a704-4abb-9e99-3fa8b080e693 tempest-VolumesActionsTest-1076551861 None] Lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5" released by "attach_volume" :: held 0.317s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Flow 'volume_create_manager' (d20dc393-37cc-4f24-8ccb-f50fe6a26a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abcc6a0-0f4e-4b72-8106-32cd7a9ce1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6abcc6a0-0f4e-4b72-8106-32cd7a9ce1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-699381078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3828a1-2545-4eda-aeb1-312d86f7af3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9b1206a4b04b60bac123d5874dfae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:44Z,use_quota=True,user_id='06a3c7a7d4344a8f9f1ac3297cc877df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75f9e09-ac27-4ff2-8de2-74b9cb3d0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75f9e09-ac27-4ff2-8de2-74b9cb3d0125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63144e3-bef4-4a14-8231-005eb581a93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63144e3-bef4-4a14-8231-005eb581a93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c3828a1-2545-4eda-aeb1-312d86f7af3a', 'volume_name': 'volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a884058a-1268-47ee-bfa8-301d392b2553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a884058a-1268-47ee-bfa8-301d392b2553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2008f522-6993-4362-8edc-7dcb3d6f8cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:43 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Volume 3c3828a1-2545-4eda-aeb1-312d86f7af3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a', 'volume_size': 1}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-699381078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3828a1-2545-4eda-aeb1-312d86f7af3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d9b1206a4b04b60bac123d5874dfae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:44Z,use_quota=True,user_id='06a3c7a7d4344a8f9f1ac3297cc877df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Creating volume 3c3828a1-2545-4eda-aeb1-312d86f7af3a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:44:43 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:44:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:43 devstack sudo[100812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a 1073741824
Nov 05 18:44:43 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:44 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a 1073741824" returned: 0 in 0.847s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:44 devstack sudo[100818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a
Nov 05 18:44:44 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-52935ffd-4577-446c-9be5-b8a6ca2bf430 tempest-VolumesActionsTest-342240181 None] Terminate volume connection completed successfully.
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-52935ffd-4577-446c-9be5-b8a6ca2bf430 tempest-VolumesActionsTest-342240181 None] Acquiring lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5-detach_volume" by "detach_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-52935ffd-4577-446c-9be5-b8a6ca2bf430 tempest-VolumesActionsTest-342240181 None] Lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-52935ffd-4577-446c-9be5-b8a6ca2bf430 tempest-VolumesActionsTest-342240181 None] Detaching volume 81655d8c-7cf1-40f0-8145-82f0760c6da5 from instance 3d7a4fc3-9a73-4859-8f8a-fc2ba8064c4a.
Nov 05 18:44:45 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a" returned: 0 in 0.443s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2008f522-6993-4362-8edc-7dcb3d6f8cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bf64c4-3ccb-44e3-b28f-1ab5dabd3afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:45 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Volume volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a (3c3828a1-2545-4eda-aeb1-312d86f7af3a): created successfully
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bf64c4-3ccb-44e3-b28f-1ab5dabd3afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Flow 'volume_create_manager' (d20dc393-37cc-4f24-8ccb-f50fe6a26a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-52935ffd-4577-446c-9be5-b8a6ca2bf430 tempest-VolumesActionsTest-342240181 None] Detach volume completed successfully.
Nov 05 18:44:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c3ce642e-72d3-411b-9cd5-df950cbf1823 tempest-VolumesMetadataTest-1094470724 None] Created volume successfully.
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-52935ffd-4577-446c-9be5-b8a6ca2bf430 tempest-VolumesActionsTest-342240181 None] Lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5-detach_volume" released by "detach_volume" :: held 0.197s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-199f02d8-032f-4efa-89f3-52b4dbbb0c08 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5-detach_volume" by "detach_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-199f02d8-032f-4efa-89f3-52b4dbbb0c08 tempest-VolumesActionsTest-1076551861 None] Lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-199f02d8-032f-4efa-89f3-52b4dbbb0c08 tempest-VolumesActionsTest-1076551861 None] Volume detach called, but volume not attached.
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-199f02d8-032f-4efa-89f3-52b4dbbb0c08 tempest-VolumesActionsTest-1076551861 None] Lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Acquiring lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Acquiring lock "cinder-quobyte-81655d8c-7cf1-40f0-8145-82f0760c6da5" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Lock "cinder-quobyte-81655d8c-7cf1-40f0-8145-82f0760c6da5" acquired by "delete_volume" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb2e03-95ba-4f14-96ba-88e14e345789]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:44:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:46 devstack sudo[100828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5
Nov 05 18:44:46 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:46 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5" returned: 0 in 0.625s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:46 devstack sudo[100833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5
Nov 05 18:44:46 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Acquiring lock "cinder-3c3828a1-2545-4eda-aeb1-312d86f7af3a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Lock "cinder-3c3828a1-2545-4eda-aeb1-312d86f7af3a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Acquiring lock "cinder-quobyte-3c3828a1-2545-4eda-aeb1-312d86f7af3a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Lock "cinder-quobyte-3c3828a1-2545-4eda-aeb1-312d86f7af3a" acquired by "delete_volume" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea4332b-460d-486b-bf13-51a86a2dad63]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:47 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-81655d8c-7cf1-40f0-8145-82f0760c6da5" returned: 0 in 0.592s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Lock "cinder-quobyte-81655d8c-7cf1-40f0-8145-82f0760c6da5" released by "delete_volume" :: held 1.275s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Created reservations ['756a965d-5cb8-4979-8d33-3023264bc825', 'e2253eca-d92d-4714-adc4-f2d309d37820', '1cda1399-9b72-4f43-9ebd-6a7e721ca72a', '431370be-a55a-4b2b-b188-1f16d606e618'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:44:47 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a
Nov 05 18:44:47 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:47 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:44:47 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:47 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.395s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:44:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Deleted volume successfully.
Nov 05 18:44:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba4224ee-f91c-4af5-aeeb-9f87ae62408a tempest-VolumesActionsTest-1076551861 None] Lock "cinder-81655d8c-7cf1-40f0-8145-82f0760c6da5-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:48 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a" returned: 0 in 0.882s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:48 devstack sudo[100880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a
Nov 05 18:44:48 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:48 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c3828a1-2545-4eda-aeb1-312d86f7af3a" returned: 0 in 0.503s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Lock "cinder-quobyte-3c3828a1-2545-4eda-aeb1-312d86f7af3a" released by "delete_volume" :: held 1.461s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Created reservations ['511984b5-22a9-4351-bf85-dfd63e6850bd', '00536556-91c2-4fed-84d7-0c0ee0588c22', '4fbd7c20-9751-42a9-a38a-f59fd2cb65e5', '0087b05e-655a-486b-81cb-3b59da7c53f3'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:48 devstack sudo[100884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:44:48 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:49 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.399s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:49 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:44:49 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Deleted volume successfully.
Nov 05 18:44:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1416df9c-f47a-48cf-bb4a-bbc662c3fe68 tempest-VolumesMetadataTest-1094470724 None] Lock "cinder-3c3828a1-2545-4eda-aeb1-312d86f7af3a-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (2519d69a-62be-4192-9073-07bf935a34bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827e90af-8d74-45ba-80fe-4f1484e14e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827e90af-8d74-45ba-80fe-4f1484e14e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1431098913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c2fc0a-f4cb-429c-8fb2-112f6131bc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:52Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057654d9-fd56-417e-a123-8502c8f214cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057654d9-fd56-417e-a123-8502c8f214cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f49382f-a41e-4d49-9a48-a90324ddc40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f49382f-a41e-4d49-9a48-a90324ddc40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c2fc0a-f4cb-429c-8fb2-112f6131bc67', 'volume_name': 'volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3654fa-344a-4869-8031-30a259545095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3654fa-344a-4869-8031-30a259545095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53bbb13-7131-4a62-b7cb-77a3a3058ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:51 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Volume e0c2fc0a-f4cb-429c-8fb2-112f6131bc67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67', 'volume_size': 1}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1431098913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c2fc0a-f4cb-429c-8fb2-112f6131bc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:52Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Creating volume e0c2fc0a-f4cb-429c-8fb2-112f6131bc67 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:44:51 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:44:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:51 devstack sudo[100913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67 1073741824
Nov 05 18:44:51 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:52 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67 1073741824" returned: 0 in 0.538s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:52 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67
Nov 05 18:44:52 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:52 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67" returned: 0 in 0.279s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:44:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53bbb13-7131-4a62-b7cb-77a3a3058ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862dfeae-30b6-4b84-a27d-b95d1fdcc3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:52 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Volume volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67 (e0c2fc0a-f4cb-429c-8fb2-112f6131bc67): created successfully
Nov 05 18:44:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862dfeae-30b6-4b84-a27d-b95d1fdcc3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:52 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (2519d69a-62be-4192-9073-07bf935a34bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:52 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6cd0fb96-5a51-496a-8a62-433f4ed159fe tempest-VolumesActionsTest-1076551861 None] Created volume successfully.
Nov 05 18:44:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Acquiring lock "cinder-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Lock "cinder-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Acquiring lock "cinder-quobyte-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Lock "cinder-quobyte-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67" acquired by "delete_volume" :: waited 0.013s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:54 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ec040a-d0a6-478b-bf6e-c7a51a3f667c]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:44:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:54 devstack sudo[100922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67
Nov 05 18:44:54 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:54 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67" returned: 0 in 0.491s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:54 devstack sudo[100927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67
Nov 05 18:44:54 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:55 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67" returned: 0 in 0.355s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Lock "cinder-quobyte-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67" released by "delete_volume" :: held 0.899s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Created reservations ['797f257b-c32c-4fe3-8ec4-71df5a7a6abc', '64e5e6e6-7d8a-4d81-9414-39ac0f2f90b5', '874f451e-5020-4ddb-863b-811167264dd5', 'f3dae926-6e14-42e8-be84-27f4690b8c20'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:55 devstack sudo[100931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:44:55 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Flow 'volume_create_manager' (ccfd976d-dcb2-49ab-b917-7eb4851cff2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2780203d-f3cf-4bf4-bb52-2b5d3af1c7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2780203d-f3cf-4bf4-bb52-2b5d3af1c7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1716184422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498a83ca-aee5-4cba-8bab-9472dc6e1c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac00a0cb002426c89f2e2a5ecb85dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:55Z,use_quota=True,user_id='6f71533f939945f585a055efe375aa49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb66f14-ae3f-4c16-9a8a-949df4e7b2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb66f14-ae3f-4c16-9a8a-949df4e7b2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6701615c-b7e1-4a50-ba84-4842fc29ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6701615c-b7e1-4a50-ba84-4842fc29ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '498a83ca-aee5-4cba-8bab-9472dc6e1c1e', 'volume_name': 'volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6b9770-a80d-460d-b507-dbd1298349a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6b9770-a80d-460d-b507-dbd1298349a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd0b6d8-734d-4025-82eb-a9b7faddd569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:55 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Volume 498a83ca-aee5-4cba-8bab-9472dc6e1c1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e', 'volume_size': 1}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1716184422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=498a83ca-aee5-4cba-8bab-9472dc6e1c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac00a0cb002426c89f2e2a5ecb85dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:55Z,use_quota=True,user_id='6f71533f939945f585a055efe375aa49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Creating volume 498a83ca-aee5-4cba-8bab-9472dc6e1c1e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:44:55 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:55 devstack sudo[100933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e 1073741824
Nov 05 18:44:55 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:55 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:44:55 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Deleted volume successfully.
Nov 05 18:44:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5655455-ab7e-4261-ba4b-69951e8bfb3c tempest-VolumesActionsTest-342240181 None] Lock "cinder-e0c2fc0a-f4cb-429c-8fb2-112f6131bc67-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:56 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e 1073741824" returned: 0 in 0.549s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:56 devstack sudo[100940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e
Nov 05 18:44:56 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:56 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e" returned: 0 in 0.300s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd0b6d8-734d-4025-82eb-a9b7faddd569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896d23a6-3548-4e59-b2bd-d9d673bcda46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:56 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Volume volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e (498a83ca-aee5-4cba-8bab-9472dc6e1c1e): created successfully
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896d23a6-3548-4e59-b2bd-d9d673bcda46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Flow 'volume_create_manager' (ccfd976d-dcb2-49ab-b917-7eb4851cff2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f82e49f0-aae0-42a4-a771-c5b1f7ffd993 tempest-VolumesTransfersV355Test-305995420 None] Created volume successfully.
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (b186e71b-400d-4dad-b7ca-a063fe85987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342b82ad-861f-455d-9512-40fe5ed45fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342b82ad-861f-455d-9512-40fe5ed45fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1275577445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19157de6-ef8b-456a-8292-96772616f15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:57Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7772bbc6-2ba2-4bbc-9d3e-00580aa79675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7772bbc6-2ba2-4bbc-9d3e-00580aa79675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41b1646-b6c9-48f0-8e08-8cbf838b3884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41b1646-b6c9-48f0-8e08-8cbf838b3884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19157de6-ef8b-456a-8292-96772616f15e', 'volume_name': 'volume-19157de6-ef8b-456a-8292-96772616f15e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e3a1a4-ea18-46c2-ad01-979ab673a8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e3a1a4-ea18-46c2-ad01-979ab673a8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe22a09-2e44-43bf-893e-ca7f4a5ab1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:57 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Volume 19157de6-ef8b-456a-8292-96772616f15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19157de6-ef8b-456a-8292-96772616f15e', 'volume_size': 1}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1275577445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19157de6-ef8b-456a-8292-96772616f15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:44:57Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Creating volume 19157de6-ef8b-456a-8292-96772616f15e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:44:57 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:57 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e 1073741824
Nov 05 18:44:57 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:57 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e 1073741824" returned: 0 in 0.484s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:57 devstack sudo[100948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e
Nov 05 18:44:57 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:57 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e" returned: 0 in 0.287s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe22a09-2e44-43bf-893e-ca7f4a5ab1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19157de6-ef8b-456a-8292-96772616f15e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67eed0d-11d0-4cc8-a660-53ed676fc2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:44:57 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Volume volume-19157de6-ef8b-456a-8292-96772616f15e (19157de6-ef8b-456a-8292-96772616f15e): created successfully
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67eed0d-11d0-4cc8-a660-53ed676fc2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:44:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (b186e71b-400d-4dad-b7ca-a063fe85987c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:44:57 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-cfe81649-2d67-4066-b1dd-268d7b0b3141 tempest-VolumesActionsTest-1076551861 None] Created volume successfully.
Nov 05 18:44:58 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e249ef50-e119-4937-b4b3-f6ab2b592e48 tempest-VolumesTransfersV355Test-830911963 None] Transfer volume completed successfully.
Nov 05 18:44:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Acquiring lock "cinder-498a83ca-aee5-4cba-8bab-9472dc6e1c1e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Lock "cinder-498a83ca-aee5-4cba-8bab-9472dc6e1c1e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Acquiring lock "cinder-quobyte-498a83ca-aee5-4cba-8bab-9472dc6e1c1e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Lock "cinder-quobyte-498a83ca-aee5-4cba-8bab-9472dc6e1c1e" acquired by "delete_volume" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f40298-8ce9-451f-8d8a-df9da25dc735]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:59 devstack sudo[100951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e
Nov 05 18:44:59 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Acquiring lock "cinder-19157de6-ef8b-456a-8292-96772616f15e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Lock "cinder-19157de6-ef8b-456a-8292-96772616f15e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Acquiring lock "cinder-quobyte-19157de6-ef8b-456a-8292-96772616f15e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Lock "cinder-quobyte-19157de6-ef8b-456a-8292-96772616f15e" acquired by "delete_volume" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc072a17-7bff-4aff-8108-51745d144d10]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:59 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e
Nov 05 18:44:59 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:59 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e" returned: 0 in 0.568s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:59 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e
Nov 05 18:44:59 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:44:59 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-498a83ca-aee5-4cba-8bab-9472dc6e1c1e" returned: 0 in 0.337s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Lock "cinder-quobyte-498a83ca-aee5-4cba-8bab-9472dc6e1c1e" released by "delete_volume" :: held 0.966s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:44:59 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e" returned: 0 in 0.512s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:44:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:44:59 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e
Nov 05 18:44:59 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Created reservations ['24a13a57-eedf-442a-9db3-c1d891a5cb34', '6478f6ee-864b-4f9d-a54f-be5e52d7baac', '36c7cbdb-d753-4f73-a6e3-179d076a6277', '475c6234-4cd0-4010-912f-8144d56cf9be'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:00 devstack sudo[100966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:00 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:00 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19157de6-ef8b-456a-8292-96772616f15e" returned: 0 in 0.297s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Lock "cinder-quobyte-19157de6-ef8b-456a-8292-96772616f15e" released by "delete_volume" :: held 0.885s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Created reservations ['a3f76e0f-7e6c-4802-8bb1-db6883a6a843', 'abd4d563-1ecd-4ff8-a0de-318f6d6c0b69', '646e75b3-51a4-40eb-9cd0-27b04490aea1', 'dc7c96bd-2189-4ddd-9f9b-b3775bfbc452'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:00 devstack sudo[100969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:00 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:00 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.313s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:00 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Deleted volume successfully.
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-05b261d5-8ed0-4cc8-961b-12f068e470dd tempest-VolumesTransfersV355Test-1515388414 None] Lock "cinder-498a83ca-aee5-4cba-8bab-9472dc6e1c1e-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:00 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.301s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:00 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Deleted volume successfully.
Nov 05 18:45:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d594fd5f-a550-4c5b-8f7c-2cceafb61d29 tempest-VolumesActionsTest-342240181 None] Lock "cinder-19157de6-ef8b-456a-8292-96772616f15e-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (4f5dd814-c20f-4e49-bf2b-67896326951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0c1ead-547b-488c-a1af-eb6aca8b57e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0c1ead-547b-488c-a1af-eb6aca8b57e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-506851176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a815667a-f75e-4783-9e4d-8d451feb4800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:01Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14657bd-a1fb-4b75-bf3c-7daed4d43cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14657bd-a1fb-4b75-bf3c-7daed4d43cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c133ddc1-7b1e-40d6-9be1-91168d8f37a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c133ddc1-7b1e-40d6-9be1-91168d8f37a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a815667a-f75e-4783-9e4d-8d451feb4800', 'volume_name': 'volume-a815667a-f75e-4783-9e4d-8d451feb4800', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9bf626-4ace-4698-8a7c-4a0b4e3318ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9bf626-4ace-4698-8a7c-4a0b4e3318ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ded635-aac7-4216-a997-08506f8334cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:01 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Volume a815667a-f75e-4783-9e4d-8d451feb4800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a815667a-f75e-4783-9e4d-8d451feb4800', 'volume_size': 1}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-506851176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a815667a-f75e-4783-9e4d-8d451feb4800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:01Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Creating volume a815667a-f75e-4783-9e4d-8d451feb4800 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:01 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:01 devstack sudo[100973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800 1073741824
Nov 05 18:45:01 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:01 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800 1073741824" returned: 0 in 0.475s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:01 devstack sudo[100982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800
Nov 05 18:45:01 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Flow 'volume_create_manager' (7f42fcfd-8dc2-4b55-90c3-2cb41ca7faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9658b5-ac5e-4bb8-b7ca-500799c1a8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:02 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800" returned: 0 in 0.309s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb9658b5-ac5e-4bb8-b7ca-500799c1a8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-128782316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559cd93e-c97d-469e-a75f-75c309860a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac00a0cb002426c89f2e2a5ecb85dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:02Z,use_quota=True,user_id='6f71533f939945f585a055efe375aa49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4d9ba8-80ba-43bd-8551-706e16c7bb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d4d9ba8-80ba-43bd-8551-706e16c7bb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0494130-ba25-4eea-bb61-3c73810ca99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0494130-ba25-4eea-bb61-3c73810ca99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '559cd93e-c97d-469e-a75f-75c309860a1a', 'volume_name': 'volume-559cd93e-c97d-469e-a75f-75c309860a1a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb7da6b-cfa1-435c-bade-0dfbe0240151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb7da6b-cfa1-435c-bade-0dfbe0240151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09adee3-0f08-47c9-89be-65d4869b3ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Volume 559cd93e-c97d-469e-a75f-75c309860a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-559cd93e-c97d-469e-a75f-75c309860a1a', 'volume_size': 1}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-128782316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=559cd93e-c97d-469e-a75f-75c309860a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac00a0cb002426c89f2e2a5ecb85dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:02Z,use_quota=True,user_id='6f71533f939945f585a055efe375aa49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Creating volume 559cd93e-c97d-469e-a75f-75c309860a1a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:02 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ded635-aac7-4216-a997-08506f8334cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a815667a-f75e-4783-9e4d-8d451feb4800', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:02 devstack sudo[100985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a 1073741824
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81c1251-8537-4ebc-bdca-4cc987506845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:02 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Volume volume-a815667a-f75e-4783-9e4d-8d451feb4800 (a815667a-f75e-4783-9e4d-8d451feb4800): created successfully
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81c1251-8537-4ebc-bdca-4cc987506845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (4f5dd814-c20f-4e49-bf2b-67896326951f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:02 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ce336e00-4ecb-46d7-8f9d-bc30d01e364e tempest-VolumesActionsTest-1076551861 None] Created volume successfully.
Nov 05 18:45:02 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a 1073741824" returned: 0 in 0.465s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:02 devstack sudo[100991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a
Nov 05 18:45:02 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:02 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a" returned: 0 in 0.289s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09adee3-0f08-47c9-89be-65d4869b3ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-559cd93e-c97d-469e-a75f-75c309860a1a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b940c8-6ae7-44d2-9b83-e59947ec7e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:03 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Volume volume-559cd93e-c97d-469e-a75f-75c309860a1a (559cd93e-c97d-469e-a75f-75c309860a1a): created successfully
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b940c8-6ae7-44d2-9b83-e59947ec7e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Flow 'volume_create_manager' (7f42fcfd-8dc2-4b55-90c3-2cb41ca7faa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:03 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e2ed8ea1-0d6d-489e-9841-cad2d30171c9 tempest-VolumesTransfersV355Test-305995420 None] Created volume successfully.
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Flow 'volume_create_manager' (f594c797-bfb3-473f-ac54-7081c70a92ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfef57a-cc4f-4397-b235-de30b9d65a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfef57a-cc4f-4397-b235-de30b9d65a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-712270143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8070c6fe-ee53-4bb5-a008-c6183f8a5861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8539a72f9d5540f388c21626d9b5befc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:03Z,use_quota=True,user_id='572d0a2125f9476bb66f849337151377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132223b8-ebb0-48ff-bc0f-2d2d609d019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132223b8-ebb0-48ff-bc0f-2d2d609d019d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc69226-5e31-441b-92ca-080bf3ab3db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc69226-5e31-441b-92ca-080bf3ab3db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8070c6fe-ee53-4bb5-a008-c6183f8a5861', 'volume_name': 'volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0262f36c-a9e1-4122-abec-677d63ada9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0262f36c-a9e1-4122-abec-677d63ada9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95acca3a-0b6f-4fbd-b128-9c411921455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:03 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Volume 8070c6fe-ee53-4bb5-a008-c6183f8a5861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861', 'volume_size': 1}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-712270143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8070c6fe-ee53-4bb5-a008-c6183f8a5861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8539a72f9d5540f388c21626d9b5befc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:03Z,use_quota=True,user_id='572d0a2125f9476bb66f849337151377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Creating volume 8070c6fe-ee53-4bb5-a008-c6183f8a5861 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:03 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:03 devstack sudo[100994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 1073741824
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Acquiring lock "cinder-a815667a-f75e-4783-9e4d-8d451feb4800-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:03 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Lock "cinder-a815667a-f75e-4783-9e4d-8d451feb4800-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Acquiring lock "cinder-quobyte-a815667a-f75e-4783-9e4d-8d451feb4800" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Lock "cinder-quobyte-a815667a-f75e-4783-9e4d-8d451feb4800" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d18bb55-b059-4bb1-a9bb-c120d6ebbdad]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:03 devstack sudo[100996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800
Nov 05 18:45:03 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:03 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 1073741824" returned: 0 in 0.563s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:03 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800" returned: 0 in 0.438s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:03 devstack sudo[101005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800
Nov 05 18:45:03 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:04 devstack sudo[101009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861
Nov 05 18:45:04 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:04 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a815667a-f75e-4783-9e4d-8d451feb4800" returned: 0 in 0.316s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Lock "cinder-quobyte-a815667a-f75e-4783-9e4d-8d451feb4800" released by "delete_volume" :: held 0.822s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Created reservations ['75127288-1162-459f-b21f-621f2461609d', '3a3a62ef-0cf4-41ef-9f14-f50dce0a95c7', 'eb58856a-6f83-446f-8612-aa45d430f9c2', 'e3cfdbc0-6838-49fc-8626-c36e6454804c'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:04 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95acca3a-0b6f-4fbd-b128-9c411921455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9855be32-1f60-4be8-9c16-7b0311a97f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:04 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Volume volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 (8070c6fe-ee53-4bb5-a008-c6183f8a5861): created successfully
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9855be32-1f60-4be8-9c16-7b0311a97f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Flow 'volume_create_manager' (f594c797-bfb3-473f-ac54-7081c70a92ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ffdd8586-1a22-410f-8978-ea47c37a2753 tempest-TestStampPattern-2010350430 None] Created volume successfully.
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:04 devstack sudo[101013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:04 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Acquiring lock "cinder-559cd93e-c97d-469e-a75f-75c309860a1a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Lock "cinder-559cd93e-c97d-469e-a75f-75c309860a1a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Acquiring lock "cinder-quobyte-559cd93e-c97d-469e-a75f-75c309860a1a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Lock "cinder-quobyte-559cd93e-c97d-469e-a75f-75c309860a1a" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f706af94-34a8-484a-83c8-5d7e5e626941]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:04 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.331s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Deleted volume successfully.
Nov 05 18:45:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5a0693b5-9219-43f6-b3c8-a66331eedb6f tempest-VolumesActionsTest-342240181 None] Lock "cinder-a815667a-f75e-4783-9e4d-8d451feb4800-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:04 devstack sudo[101015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a
Nov 05 18:45:04 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (a5c19e08-6d5c-4a6b-bb25-ea94516d2360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e44ea9-07dd-4259-85f3-52ab68a074a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e44ea9-07dd-4259-85f3-52ab68a074a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-423451394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:05Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248f2bf7-c079-4c57-b564-b913629752eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (248f2bf7-c079-4c57-b564-b913629752eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26cba47-0277-4ae8-86a5-8edbe4ed2b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26cba47-0277-4ae8-86a5-8edbe4ed2b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2', 'volume_name': 'volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2711dcdb-f6e1-41a1-a9ab-07153359e333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2711dcdb-f6e1-41a1-a9ab-07153359e333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5473317a-418a-428c-80f4-8544f3115576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:05 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Volume 0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2', 'volume_size': 1}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-423451394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:05Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Creating volume 0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:05 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:05 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a" returned: 0 in 0.576s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:05 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2 1073741824
Nov 05 18:45:05 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:05 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a
Nov 05 18:45:05 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:05 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-559cd93e-c97d-469e-a75f-75c309860a1a" returned: 0 in 0.292s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Lock "cinder-quobyte-559cd93e-c97d-469e-a75f-75c309860a1a" released by "delete_volume" :: held 0.916s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Created reservations ['561dfa71-d9bf-4760-a33d-a2bb214bdf79', '99e09169-7f8e-430d-ab09-80175b6d69f7', 'c62db0cc-6482-4bec-909c-4d796115011b', '59962140-6238-4f87-9abe-0253684189e7'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:05 devstack sudo[101032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:05 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:05 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2 1073741824" returned: 0 in 0.587s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:06 devstack sudo[101037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2
Nov 05 18:45:06 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:06 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2" returned: 0 in 0.312s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:06 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.414s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:06 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:06 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Deleted volume successfully.
Nov 05 18:45:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5473317a-418a-428c-80f4-8544f3115576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9415ef-c8de-4f46-959f-31d663ad4bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-94d172fa-f9b7-4c53-9819-e857dc93cbd8 tempest-VolumesTransfersV355Test-1515388414 None] Lock "cinder-559cd93e-c97d-469e-a75f-75c309860a1a-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:06 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Volume volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2 (0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2): created successfully
Nov 05 18:45:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9415ef-c8de-4f46-959f-31d663ad4bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (a5c19e08-6d5c-4a6b-bb25-ea94516d2360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:06 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-dd116327-45fd-4299-a694-bd49396a6ea2 tempest-VolumesActionsTest-1076551861 None] Created volume successfully.
Nov 05 18:45:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Acquiring lock "cinder-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Lock "cinder-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Acquiring lock "cinder-quobyte-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Lock "cinder-quobyte-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2" acquired by "delete_volume" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:07 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[63610d40-a0d6-4b15-b052-b7fd5ebcdabb]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:07 devstack sudo[101056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2
Nov 05 18:45:07 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:08 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2" returned: 0 in 0.511s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:08 devstack sudo[101062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2
Nov 05 18:45:08 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:08 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2" returned: 0 in 0.315s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Lock "cinder-quobyte-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2" released by "delete_volume" :: held 0.916s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Created reservations ['13c43a70-3295-445c-a8d9-f20de5b5ccda', 'd2095aa6-dca0-4344-b50e-158f214bbf13', '5aecb0d2-6d6f-4f66-af0e-7cce354f006d', 'c4fc62f7-0412-42e0-812a-74dca56ff180'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:08 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:08 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:09 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.520s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:09 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:09 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Deleted volume successfully.
Nov 05 18:45:09 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a4e79ffb-1eb1-447d-a660-6fda6b27a11b tempest-VolumesActionsTest-342240181 None] Lock "cinder-0f6f304b-9d32-4d7f-aa4d-5f6fe2706aa2-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (5cb18c48-a6fe-48c5-922b-f8046946ddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca191ab-aa6d-4fd1-b501-6395dcaf4c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca191ab-aa6d-4fd1-b501-6395dcaf4c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2055249118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b300f6b-284c-4905-be17-a3f6711acb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:11Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1e7081-d3a6-48a0-83bd-5cd60ad61085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1e7081-d3a6-48a0-83bd-5cd60ad61085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4343f-827a-4c18-aae0-58c5aae90645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b4343f-827a-4c18-aae0-58c5aae90645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b300f6b-284c-4905-be17-a3f6711acb76', 'volume_name': 'volume-6b300f6b-284c-4905-be17-a3f6711acb76', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa1f2a3-cb24-45cf-aef6-265fd1f0c9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aa1f2a3-cb24-45cf-aef6-265fd1f0c9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef437b90-13e7-4269-ba7f-67797f1c9dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:10 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Volume 6b300f6b-284c-4905-be17-a3f6711acb76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b300f6b-284c-4905-be17-a3f6711acb76', 'volume_size': 1}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2055249118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b300f6b-284c-4905-be17-a3f6711acb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede86467cba6447d97bbb591f72f7218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:11Z,use_quota=True,user_id='9cebf73e7fa041319fc547c13a2ac02b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Creating volume 6b300f6b-284c-4905-be17-a3f6711acb76 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:10 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:10 devstack sudo[101137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76 1073741824
Nov 05 18:45:10 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:11 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76 1073741824" returned: 0 in 0.806s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:11 devstack sudo[101145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76
Nov 05 18:45:11 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:12 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76" returned: 0 in 0.556s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef437b90-13e7-4269-ba7f-67797f1c9dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b300f6b-284c-4905-be17-a3f6711acb76', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9f9e3e-c7fc-49c6-9e7c-9cd4c9fec534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:12 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Volume volume-6b300f6b-284c-4905-be17-a3f6711acb76 (6b300f6b-284c-4905-be17-a3f6711acb76): created successfully
Nov 05 18:45:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9f9e3e-c7fc-49c6-9e7c-9cd4c9fec534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Flow 'volume_create_manager' (5cb18c48-a6fe-48c5-922b-f8046946ddfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:12 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-42eb1fd3-15d2-4dea-8b12-23929b7fc3e7 tempest-VolumesActionsTest-1076551861 None] Created volume successfully.
Nov 05 18:45:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "cinder-6b300f6b-284c-4905-be17-a3f6711acb76-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Lock "cinder-6b300f6b-284c-4905-be17-a3f6711acb76-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "cinder-quobyte-6b300f6b-284c-4905-be17-a3f6711acb76" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Lock "cinder-quobyte-6b300f6b-284c-4905-be17-a3f6711acb76" acquired by "delete_volume" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:13 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d1debd-d0b0-47da-b05e-00503ff2d112]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:13 devstack sudo[101148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76
Nov 05 18:45:13 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:14 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76" returned: 0 in 0.545s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:14 devstack sudo[101155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76
Nov 05 18:45:14 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:14 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b300f6b-284c-4905-be17-a3f6711acb76" returned: 0 in 0.318s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Lock "cinder-quobyte-6b300f6b-284c-4905-be17-a3f6711acb76" released by "delete_volume" :: held 0.937s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Created reservations ['728b3b47-b910-4d4c-b2ce-2a2505f077fe', '988d4137-ef54-439e-9ab9-2a20ae30d535', '2456978d-0ec6-4071-9101-c7614857574c', '9163f270-2d5e-458e-9ea7-a0ec6d671aad'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:14 devstack sudo[101159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:14 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:15 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:15 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Deleted volume successfully.
Nov 05 18:45:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d307bfcb-bb89-40a7-86d3-35ebd141b687 tempest-VolumesActionsTest-1076551861 None] Lock "cinder-6b300f6b-284c-4905-be17-a3f6711acb76-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Flow 'volume_create_manager' (c96dde1d-42ab-4458-bad9-a3d6062d6bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619c47a4-317f-466f-85df-2194c98e8242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (619c47a4-317f-466f-85df-2194c98e8242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1985770380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529c94d3-6475-4135-bcd9-2a0e162f0e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ae526c366442729dc5d992fc030607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:18Z,use_quota=True,user_id='66560778aaa14f42968a5ae4f496d6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63cc837-845d-487e-b32d-ee6f1478b293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63cc837-845d-487e-b32d-ee6f1478b293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01072282-187a-47f6-8bef-beda0d2bf47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01072282-187a-47f6-8bef-beda0d2bf47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529c94d3-6475-4135-bcd9-2a0e162f0e39', 'volume_name': 'volume-529c94d3-6475-4135-bcd9-2a0e162f0e39', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0b7960-c8fa-43f6-8fc6-cf37f6b372c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0b7960-c8fa-43f6-8fc6-cf37f6b372c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125e8818-270c-4719-bdfc-2a206ff4355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:18 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Volume 529c94d3-6475-4135-bcd9-2a0e162f0e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529c94d3-6475-4135-bcd9-2a0e162f0e39', 'volume_size': 1}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1985770380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529c94d3-6475-4135-bcd9-2a0e162f0e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ae526c366442729dc5d992fc030607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:18Z,use_quota=True,user_id='66560778aaa14f42968a5ae4f496d6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Creating volume 529c94d3-6475-4135-bcd9-2a0e162f0e39 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:18 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:18 devstack sudo[101164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39 1073741824
Nov 05 18:45:18 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:18 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39 1073741824" returned: 0 in 0.506s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:18 devstack sudo[101171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39
Nov 05 18:45:18 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:19 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39" returned: 0 in 0.242s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125e8818-270c-4719-bdfc-2a206ff4355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529c94d3-6475-4135-bcd9-2a0e162f0e39', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154a98ef-a1aa-49c2-bced-ec07b11ab892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:19 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Volume volume-529c94d3-6475-4135-bcd9-2a0e162f0e39 (529c94d3-6475-4135-bcd9-2a0e162f0e39): created successfully
Nov 05 18:45:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154a98ef-a1aa-49c2-bced-ec07b11ab892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Flow 'volume_create_manager' (c96dde1d-42ab-4458-bad9-a3d6062d6bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:19 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-11f17380-3221-4f7c-8ab9-3fb61742e3c4 tempest-VolumesTransfersV357Test-243414410 None] Created volume successfully.
Nov 05 18:45:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d38b75fb-a935-42ad-8c10-cb7f8f584cc3 tempest-VolumesTransfersV357Test-1432507174 None] Transfer volume completed successfully.
Nov 05 18:45:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Acquiring lock "cinder-529c94d3-6475-4135-bcd9-2a0e162f0e39-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Lock "cinder-529c94d3-6475-4135-bcd9-2a0e162f0e39-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Acquiring lock "cinder-quobyte-529c94d3-6475-4135-bcd9-2a0e162f0e39" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Lock "cinder-quobyte-529c94d3-6475-4135-bcd9-2a0e162f0e39" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:21 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f259db47-ea6c-4fd6-aeb1-9aa1bc1710ea]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:22 devstack sudo[101175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39
Nov 05 18:45:22 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:22 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39" returned: 0 in 0.423s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:22 devstack sudo[101181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39
Nov 05 18:45:22 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:22 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-529c94d3-6475-4135-bcd9-2a0e162f0e39" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Lock "cinder-quobyte-529c94d3-6475-4135-bcd9-2a0e162f0e39" released by "delete_volume" :: held 0.753s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Created reservations ['730bd53a-2a2c-4d2a-b5c4-d1636537b7c1', 'ecba36ab-6911-4f9f-b080-004f97199d9b', '0ef7c4f0-b3c5-463b-8496-764079b7de36', 'bf953caf-31fd-4545-82dc-e494aef9ddde'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:22 devstack sudo[101201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:22 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:23 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.319s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Deleted volume successfully.
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7a2ed885-4fa5-4a59-ba88-445bdb21e1e3 tempest-VolumesTransfersV357Test-299436459 None] Lock "cinder-529c94d3-6475-4135-bcd9-2a0e162f0e39-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Flow 'volume_create_manager' (286a620b-c146-48a2-adcc-dd0e1a4b1732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdc5177-9964-41f4-9bcd-c4d4db0b5502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdc5177-9964-41f4-9bcd-c4d4db0b5502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1919855667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ae526c366442729dc5d992fc030607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:24Z,use_quota=True,user_id='66560778aaa14f42968a5ae4f496d6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d3bc9e-d10b-446c-a890-cb32b555d04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d3bc9e-d10b-446c-a890-cb32b555d04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62c6213-b7e2-41db-9058-0917ed335e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62c6213-b7e2-41db-9058-0917ed335e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1cf3d3b-390a-4d4b-9ea8-1807994f9ba6', 'volume_name': 'volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733caeca-a143-478a-8375-fc48351d7760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733caeca-a143-478a-8375-fc48351d7760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58703eaa-c563-4ffa-a411-b265243bd0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Volume d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6', 'volume_size': 1}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1919855667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ae526c366442729dc5d992fc030607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:24Z,use_quota=True,user_id='66560778aaa14f42968a5ae4f496d6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Creating volume d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:23 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:23 devstack sudo[101206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6 1073741824
Nov 05 18:45:23 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:24 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6 1073741824" returned: 0 in 0.451s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:24 devstack sudo[101211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6
Nov 05 18:45:24 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:24 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6" returned: 0 in 0.293s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58703eaa-c563-4ffa-a411-b265243bd0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf0d7a8-2bd6-4b18-ba80-88f6d383f51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:24 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Volume volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6 (d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6): created successfully
Nov 05 18:45:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf0d7a8-2bd6-4b18-ba80-88f6d383f51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Flow 'volume_create_manager' (286a620b-c146-48a2-adcc-dd0e1a4b1732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3b80786b-9e04-4b80-9c6b-e14c41829f5c tempest-VolumesTransfersV357Test-243414410 None] Created volume successfully.
Nov 05 18:45:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Acquiring lock "cinder-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Lock "cinder-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Acquiring lock "cinder-quobyte-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Lock "cinder-quobyte-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9330ce78-d1a5-4da8-824f-ef91a6195c0a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:25 devstack sudo[101214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6
Nov 05 18:45:25 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:25 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6" returned: 0 in 0.449s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:25 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6
Nov 05 18:45:25 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:25 devstack sudo[101223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:25 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:25 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6" returned: 0 in 0.267s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Lock "cinder-quobyte-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6" released by "delete_volume" :: held 0.768s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:25 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.270s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Created reservations ['47ae0287-2957-4be8-ad5a-f677024d983e', '123e1bf4-c5d9-4c3a-aab4-930e56fb1316', '94618f4b-58b0-45d2-8c12-a659be6bafa6', '699cf292-63a9-4fcc-9c55-6385fa434ab1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:26 devstack sudo[101227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:26 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:26 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Deleted volume successfully.
Nov 05 18:45:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0b6e383f-adfd-4b11-b562-4f27542e2b14 tempest-VolumesTransfersV357Test-299436459 None] Lock "cinder-d1cf3d3b-390a-4d4b-9ea8-1807994f9ba6-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Flow 'volume_create_manager' (ee2cd217-c1a2-4d79-ac7c-3593d1823aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0937ea-5b55-4531-ba5a-d01fb47906ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0937ea-5b55-4531-ba5a-d01fb47906ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-762697665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54360974-507e-4345-badd-b522669fc6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2b3d0a9bb440c49a10c5fe87aad3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:33Z,use_quota=True,user_id='12b3bc3e0035484188f437f33fa628eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db7ca42-633a-4605-971a-54e9c8ee97b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db7ca42-633a-4605-971a-54e9c8ee97b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e36a8a3-9ea2-45de-ab0f-fc47958c550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e36a8a3-9ea2-45de-ab0f-fc47958c550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54360974-507e-4345-badd-b522669fc6f2', 'volume_name': 'volume-54360974-507e-4345-badd-b522669fc6f2', 'volume_size': 2}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20ca4b1-3a46-4382-a36a-5fddabf50114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20ca4b1-3a46-4382-a36a-5fddabf50114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f992905f-040f-4dd9-a8a6-42c7080e8a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:33 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Volume 54360974-507e-4345-badd-b522669fc6f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54360974-507e-4345-badd-b522669fc6f2', 'volume_size': 2}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-762697665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54360974-507e-4345-badd-b522669fc6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea2b3d0a9bb440c49a10c5fe87aad3f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:33Z,use_quota=True,user_id='12b3bc3e0035484188f437f33fa628eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Creating volume 54360974-507e-4345-badd-b522669fc6f2 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:33 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2 2147483648 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:33 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2 2147483648
Nov 05 18:45:33 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Flow 'volume_create_manager' (4d0e8d71-c5ae-4a93-b613-a7cf94d1425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b7af44-e41e-426f-91c9-98d32b138a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b7af44-e41e-426f-91c9-98d32b138a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-625455986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7244f325-f070-4d2f-842c-ec26f39de8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76eb22c066f44352a4f0912f26748627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:34Z,use_quota=True,user_id='900608c77b514e5784b55be25a404099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6613b2-e987-48ea-864f-88cc9bebcf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6613b2-e987-48ea-864f-88cc9bebcf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfcdcef-f892-480d-ab3f-f4e0003a4d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.image.glance [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Creating Keystone auth plugin from conf {{(pid=87086) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfcdcef-f892-480d-ab3f-f4e0003a4d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7244f325-f070-4d2f-842c-ec26f39de8d9', 'volume_name': 'volume-7244f325-f070-4d2f-842c-ec26f39de8d9', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea3b9190>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ffaa41-f714-409e-b627-1f00ac70082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ffaa41-f714-409e-b627-1f00ac70082e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62419d0f-b48a-404f-848f-7762ad3134e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:33 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Volume 7244f325-f070-4d2f-842c-ec26f39de8d9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7244f325-f070-4d2f-842c-ec26f39de8d9', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea3b9190>}
Nov 05 18:45:33 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Trying to clone 7244f325-f070-4d2f-842c-ec26f39de8d9 from image f12bcbef-da90-40ac-bcfe-4218bc9aa565 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]). {{(pid=87086) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 18:45:34 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2 2147483648" returned: 0 in 0.602s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:34 devstack sudo[101238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2
Nov 05 18:45:34 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 18:45:34 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb0306f-74d8-4c52-a3cb-6d6b46afdc0f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:34 devstack sudo[101244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD
Nov 05 18:45:34 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:34 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2" returned: 0 in 0.317s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f992905f-040f-4dd9-a8a6-42c7080e8a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54360974-507e-4345-badd-b522669fc6f2', 'volume_size': 2}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebadd8b-8483-4060-b381-40e1c4f01fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:34 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Volume volume-54360974-507e-4345-badd-b522669fc6f2 (54360974-507e-4345-badd-b522669fc6f2): created successfully
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebadd8b-8483-4060-b381-40e1c4f01fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Flow 'volume_create_manager' (ee2cd217-c1a2-4d79-ac7c-3593d1823aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:34 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1b71b0cf-3680-4582-b3e8-afa0c5881ae3 tempest-VolumesCloneNegativeTest-1082433043 None] Created volume successfully.
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=91,cinder:UPDATE=136,cinder:DELETE=14,cinder:INSERT=33 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:45:34 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Temporary image f12bcbef-da90-40ac-bcfe-4218bc9aa565 is fetched for user 900608c77b514e5784b55be25a404099. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=126,cinder:SELECT=91,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5941ee-05ad-4589-8268-7de5c7249902]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:34 devstack sudo[101254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD
Nov 05 18:45:34 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:35 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-625455986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7244f325-f070-4d2f-842c-ec26f39de8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76eb22c066f44352a4f0912f26748627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:34Z,use_quota=True,user_id='900608c77b514e5784b55be25a404099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Creating volume 7244f325-f070-4d2f-842c-ec26f39de8d9 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:35 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:35 devstack sudo[101265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 1073741824
Nov 05 18:45:35 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-074450d4-d196-4023-97c2-11b617cff196 req-745641bb-9373-4dd3-9565-d5847016a3b6 tempest-TestStampPattern-2010350430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:35 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 1073741824" returned: 0 in 0.458s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:35 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9
Nov 05 18:45:35 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Acquiring lock "cinder-54360974-507e-4345-badd-b522669fc6f2-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Lock "cinder-54360974-507e-4345-badd-b522669fc6f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Acquiring lock "cinder-quobyte-54360974-507e-4345-badd-b522669fc6f2" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Lock "cinder-quobyte-54360974-507e-4345-badd-b522669fc6f2" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56aca8a-73ee-4d39-b971-dd52a6487ea6]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:35 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9" returned: 0 in 0.265s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-074450d4-d196-4023-97c2-11b617cff196 req-745641bb-9373-4dd3-9565-d5847016a3b6 tempest-TestStampPattern-2010350430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.605s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-074450d4-d196-4023-97c2-11b617cff196 req-745641bb-9373-4dd3-9565-d5847016a3b6 tempest-TestStampPattern-2010350430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:35 devstack sudo[101276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2
Nov 05 18:45:35 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Attempting download of f12bcbef-da90-40ac-bcfe-4218bc9aa565 ((None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}])) to volume 7244f325-f070-4d2f-842c-ec26f39de8d9. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-074450d4-d196-4023-97c2-11b617cff196 req-745641bb-9373-4dd3-9565-d5847016a3b6 tempest-TestStampPattern-2010350430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8839152b-a5dc-4eb5-93af-fb1bffbb5813', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aaf976-3d8c-49ac-92ef-fc8cc894549f]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_3pscozpg {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-074450d4-d196-4023-97c2-11b617cff196 req-745641bb-9373-4dd3-9565-d5847016a3b6 tempest-TestStampPattern-2010350430 None] attachment_update completed successfully.
Nov 05 18:45:36 devstack sudo[101279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_3pscozpg
Nov 05 18:45:36 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:36 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2" returned: 0 in 0.426s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:36 devstack sudo[101309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2
Nov 05 18:45:36 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:36 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_3pscozpg" returned: 0 in 0.362s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_3pscozpg {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:36 devstack sudo[101388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_3pscozpg
Nov 05 18:45:36 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:36 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-54360974-507e-4345-badd-b522669fc6f2" returned: 0 in 0.285s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Lock "cinder-quobyte-54360974-507e-4345-badd-b522669fc6f2" released by "delete_volume" :: held 0.767s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Created reservations ['e7e76dd2-12f7-43c6-8314-bd5bea4eead5', '61989b06-ed23-4ae8-903a-36b91402aa15', 'db39f247-14a4-49d7-99cf-a3697a5aa227', '7f968517-b8e8-4907-9012-53b48914b533'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:36 devstack sudo[101706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:36 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:36 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_3pscozpg" returned: 1 in 0.396s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_3pscozpg' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f6b758-ca4a-4556-aa61-8736c8de9cd7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:36 devstack sudo[101712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD
Nov 05 18:45:36 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:37 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.352s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:37 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:37 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Deleted volume successfully.
Nov 05 18:45:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a5187b16-5419-49eb-ad54-f226a59dbfa2 tempest-VolumesCloneNegativeTest-1082433043 None] Lock "cinder-54360974-507e-4345-badd-b522669fc6f2-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:37 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:37 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] f12bcbef-da90-40ac-bcfe-4218bc9aa565 was qcow2, converting to qcow2 {{(pid=87086) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 18:45:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:37 devstack sudo[101718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9
Nov 05 18:45:37 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:39 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9" returned: 0 in 2.293s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:39 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_lkhj6dpadevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:45:39 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Converted 112.00 MB image at 48.82 MB/s
Nov 05 18:45:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:39 devstack sudo[101742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 1G
Nov 05 18:45:39 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:40 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 1G" returned: 0 in 0.435s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:40 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Downloaded image f12bcbef-da90-40ac-bcfe-4218bc9aa565 ((None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}])) to volume 7244f325-f070-4d2f-842c-ec26f39de8d9 successfully. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 18:45:40 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Temporary image f12bcbef-da90-40ac-bcfe-4218bc9aa565 for user 900608c77b514e5784b55be25a404099 is deleted. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 18:45:40 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Marking volume 7244f325-f070-4d2f-842c-ec26f39de8d9 as bootable. {{(pid=87086) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 18:45:40 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Copying metadata from image f12bcbef-da90-40ac-bcfe-4218bc9aa565 to 7244f325-f070-4d2f-842c-ec26f39de8d9. {{(pid=87086) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 18:45:40 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Creating volume glance metadata for volume 7244f325-f070-4d2f-842c-ec26f39de8d9 backed by image f12bcbef-da90-40ac-bcfe-4218bc9aa565 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87086) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 18:45:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62419d0f-b48a-404f-848f-7762ad3134e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7244f325-f070-4d2f-842c-ec26f39de8d9', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea3b9190>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8911f4-478a-4f9b-ab17-7932a2cefc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:40 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Volume volume-7244f325-f070-4d2f-842c-ec26f39de8d9 (7244f325-f070-4d2f-842c-ec26f39de8d9): created successfully
Nov 05 18:45:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8911f4-478a-4f9b-ab17-7932a2cefc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Flow 'volume_create_manager' (4d0e8d71-c5ae-4a93-b613-a7cf94d1425a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:40 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-41cdbfdb-e91e-4088-bb5f-9335fdcba370 tempest-VolumesImageMetadata-484333075 None] Created volume successfully.
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (61ec570e-7c0f-4d95-914d-a77742ca9cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00074cdc-a680-4931-8ac3-ccd4fb0f12ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00074cdc-a680-4931-8ac3-ccd4fb0f12ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1391755431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52991274-4f7a-4017-845b-dcc130c3abf9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:42Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3dff82-16d3-4b4a-9bdc-928b6340f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3dff82-16d3-4b4a-9bdc-928b6340f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccb35bb-8e05-43e8-b413-ab07279999c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccb35bb-8e05-43e8-b413-ab07279999c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52991274-4f7a-4017-845b-dcc130c3abf9', 'volume_name': 'volume-52991274-4f7a-4017-845b-dcc130c3abf9', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4b8bb3-ba92-4269-86d8-c35ab53cb2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4b8bb3-ba92-4269-86d8-c35ab53cb2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca7939f-bd5c-4c4b-9d4c-c5fce76806a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:41 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Volume 52991274-4f7a-4017-845b-dcc130c3abf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52991274-4f7a-4017-845b-dcc130c3abf9', 'volume_size': 1}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1391755431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52991274-4f7a-4017-845b-dcc130c3abf9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:42Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Creating volume 52991274-4f7a-4017-845b-dcc130c3abf9 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:41 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Acquiring lock "cinder-7244f325-f070-4d2f-842c-ec26f39de8d9-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:41 devstack sudo[101787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9 1073741824
Nov 05 18:45:41 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Lock "cinder-7244f325-f070-4d2f-842c-ec26f39de8d9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:41 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-75daa6dd-523b-4b97-a978-d147f5d14812 req-df7cc431-243d-4ae6-88a6-cdcfe10595ee tempest-TestStampPattern-2010350430 None] Terminate volume connection completed successfully.
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-75daa6dd-523b-4b97-a978-d147f5d14812 req-df7cc431-243d-4ae6-88a6-cdcfe10595ee tempest-TestStampPattern-2010350430 None] Deleting attachment 8839152b-a5dc-4eb5-93af-fb1bffbb5813. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Acquiring lock "cinder-quobyte-7244f325-f070-4d2f-842c-ec26f39de8d9" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Lock "cinder-quobyte-7244f325-f070-4d2f-842c-ec26f39de8d9" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a2c50-e9b6-446c-84dd-26a6ee253048]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:42 devstack sudo[101789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9
Nov 05 18:45:42 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:42 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9 1073741824" returned: 0 in 0.543s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:42 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9" returned: 0 in 0.428s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:42 devstack sudo[101799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9
Nov 05 18:45:42 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:42 devstack sudo[101801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9
Nov 05 18:45:42 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:42 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7244f325-f070-4d2f-842c-ec26f39de8d9" returned: 0 in 0.303s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:42 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Lock "cinder-quobyte-7244f325-f070-4d2f-842c-ec26f39de8d9" released by "delete_volume" :: held 0.784s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9" returned: 0 in 0.292s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.062s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Creating offline snapshot 12074e90-2454-46f2-b1f6-fe3355a98fc3 of volume 8070c6fe-ee53-4bb5-a008-c6183f8a5861 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca7939f-bd5c-4c4b-9d4c-c5fce76806a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52991274-4f7a-4017-845b-dcc130c3abf9', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bfbcb1-7f99-407c-8420-7826e5e6be8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[57abc01d-1ba3-437d-a0b8-16107055e238]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:42 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Volume volume-52991274-4f7a-4017-845b-dcc130c3abf9 (52991274-4f7a-4017-845b-dcc130c3abf9): created successfully
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bfbcb1-7f99-407c-8420-7826e5e6be8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (61ec570e-7c0f-4d95-914d-a77742ca9cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:42 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-64f6d5ba-b808-4e96-b9ea-2dddae3f506e tempest-VolumesGetTest-145729097 None] Created volume successfully.
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Created reservations ['d80d948a-2d09-4d49-b27b-498a81afd751', '093ed57a-a139-461d-827d-9be65dbb8044', 'e5e5d57b-12d6-4799-ba40-b735a35b80da', '43bcc01e-9cb2-483f-8d26-b0320882634f'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:42 devstack sudo[101805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861
Nov 05 18:45:42 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:42 devstack sudo[101807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:42 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:43 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861" returned: 0 in 0.390s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:43 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:43 devstack sudo[101813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 1G
Nov 05 18:45:43 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.269s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:43 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Deleted volume successfully.
Nov 05 18:45:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a7f645fc-061e-4752-822f-baf74911f2a6 tempest-VolumesImageMetadata-484333075 None] Lock "cinder-7244f325-f070-4d2f-842c-ec26f39de8d9-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:43 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 1G" returned: 0 in 0.452s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:43 devstack sudo[101819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3
Nov 05 18:45:43 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:43 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3" returned: 0 in 0.344s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:43 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 is being set with open permissions: ugo+rw
Nov 05 18:45:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:44 devstack sudo[101825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3
Nov 05 18:45:44 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:44 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3" returned: 0 in 0.388s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:44 devstack sudo[101828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.info
Nov 05 18:45:44 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:44 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.info" returned: 0 in 0.301s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:44 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.info is being set with open permissions: ugo+rw
Nov 05 18:45:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:44 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.info
Nov 05 18:45:44 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:45 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.info" returned: 0 in 0.371s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (f469389f-2410-4ac7-b22c-ff9b4cc737eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e009aeca-1e5d-4e86-9a5e-1a7d28af1e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e009aeca-1e5d-4e86-9a5e-1a7d28af1e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-816020463',display_name='tempest-VolumesGetTest-Volume-1426496428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41eebc5-a813-487e-bcc2-698fa1029a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:45Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bb7e5f-de8d-4e60-bc7c-ebce80cc5ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bb7e5f-de8d-4e60-bc7c-ebce80cc5ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afd118e-c5f6-4627-a40d-99ccbc4f86f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afd118e-c5f6-4627-a40d-99ccbc4f86f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41eebc5-a813-487e-bcc2-698fa1029a0f', 'volume_name': 'volume-b41eebc5-a813-487e-bcc2-698fa1029a0f', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef755d93-a731-466a-a676-e4089cc906a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef755d93-a731-466a-a676-e4089cc906a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821e0e58-aed4-46aa-9545-5c961d558a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:45 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Volume b41eebc5-a813-487e-bcc2-698fa1029a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41eebc5-a813-487e-bcc2-698fa1029a0f', 'volume_size': 1}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-816020463',display_name='tempest-VolumesGetTest-Volume-1426496428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41eebc5-a813-487e-bcc2-698fa1029a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:45Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Creating volume b41eebc5-a813-487e-bcc2-698fa1029a0f {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:45 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9c4d82ff-5d58-4e0d-8361-7c3e38c81611 tempest-TestStampPattern-2010350430 None] Create snapshot completed successfully
Nov 05 18:45:45 devstack sudo[101839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f 1073741824
Nov 05 18:45:45 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:45 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f 1073741824" returned: 0 in 0.450s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:45 devstack sudo[101847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f
Nov 05 18:45:45 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:45 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f" returned: 0 in 0.282s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821e0e58-aed4-46aa-9545-5c961d558a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41eebc5-a813-487e-bcc2-698fa1029a0f', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9596b5e0-8c71-40d7-98ba-53bfdf1e9ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:46 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Volume volume-b41eebc5-a813-487e-bcc2-698fa1029a0f (b41eebc5-a813-487e-bcc2-698fa1029a0f): created successfully
Nov 05 18:45:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9596b5e0-8c71-40d7-98ba-53bfdf1e9ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (f469389f-2410-4ac7-b22c-ff9b4cc737eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3109475a-de86-4fde-b21f-f304dca8ae54 tempest-VolumesGetTest-145729097 None] Created volume successfully.
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-b41eebc5-a813-487e-bcc2-698fa1029a0f-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Lock "cinder-b41eebc5-a813-487e-bcc2-698fa1029a0f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-quobyte-b41eebc5-a813-487e-bcc2-698fa1029a0f" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-b41eebc5-a813-487e-bcc2-698fa1029a0f" acquired by "delete_volume" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[43575749-9537-4b98-b49a-aadb030eca08]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Flow 'volume_create_manager' (64b7cc0b-8707-4a84-8a14-50096c36460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b2b57c-13e3-498c-9fa1-0b37557ab4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b2b57c-13e3-498c-9fa1-0b37557ab4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1956736118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4b3190-4733-4375-bd8f-9d5228cd46de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5f0e4083f9481aa22223b01d3966bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:47Z,use_quota=True,user_id='4bd8dfb6b8f54264b5c0e14731bf16eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02790a9b-f602-4c37-a2f9-6caf7b530d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02790a9b-f602-4c37-a2f9-6caf7b530d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d9f0da-e32b-43a2-959a-c87169e4ffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d9f0da-e32b-43a2-959a-c87169e4ffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4b3190-4733-4375-bd8f-9d5228cd46de', 'volume_name': 'volume-cd4b3190-4733-4375-bd8f-9d5228cd46de', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4f8952-7d84-4ccc-bb6b-b176ea41cc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:47 devstack sudo[101851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f
Nov 05 18:45:47 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4f8952-7d84-4ccc-bb6b-b176ea41cc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb98931-8853-4557-916b-ba3812f15815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:47 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Volume cd4b3190-4733-4375-bd8f-9d5228cd46de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4b3190-4733-4375-bd8f-9d5228cd46de', 'volume_size': 1}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1956736118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4b3190-4733-4375-bd8f-9d5228cd46de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5f0e4083f9481aa22223b01d3966bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:47Z,use_quota=True,user_id='4bd8dfb6b8f54264b5c0e14731bf16eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Creating volume cd4b3190-4733-4375-bd8f-9d5228cd46de {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:47 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:47 devstack sudo[101856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de 1073741824
Nov 05 18:45:47 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:47 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f" returned: 0 in 0.424s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:47 devstack sudo[101877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f
Nov 05 18:45:47 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:48 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de 1073741824" returned: 0 in 0.511s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:48 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de
Nov 05 18:45:48 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:48 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b41eebc5-a813-487e-bcc2-698fa1029a0f" returned: 0 in 0.339s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-b41eebc5-a813-487e-bcc2-698fa1029a0f" released by "delete_volume" :: held 0.815s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Created reservations ['7a7a0f71-f2df-46b2-8ee0-75acc3a3cad9', '682693c1-74ff-48ad-bb49-70037c6d7f22', 'a2e39123-69c8-454d-9b27-26f052bdd998', 'e92c0b76-00fa-4b61-8e1b-cf560d2004c1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:48 devstack sudo[101884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:48 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:48 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de" returned: 0 in 0.311s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb98931-8853-4557-916b-ba3812f15815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4b3190-4733-4375-bd8f-9d5228cd46de', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899fe6df-a8c2-403d-b643-572d127c8226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:48 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Volume volume-cd4b3190-4733-4375-bd8f-9d5228cd46de (cd4b3190-4733-4375-bd8f-9d5228cd46de): created successfully
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899fe6df-a8c2-403d-b643-572d127c8226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Flow 'volume_create_manager' (64b7cc0b-8707-4a84-8a14-50096c36460d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:48 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-32421c7b-98b8-4c64-a504-40a7ab534b05 tempest-SnapshotMetadataTestJSON-941601504 None] Created volume successfully.
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-52991274-4f7a-4017-845b-dcc130c3abf9-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Lock "cinder-52991274-4f7a-4017-845b-dcc130c3abf9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-quobyte-52991274-4f7a-4017-845b-dcc130c3abf9" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-52991274-4f7a-4017-845b-dcc130c3abf9" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b51a09-fad9-402d-afee-02d580f8567c]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:48 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.501s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:48 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Deleted volume successfully.
Nov 05 18:45:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4640e043-8fee-4d8d-a385-f582924c0e66 tempest-VolumesGetTest-145729097 None] Lock "cinder-b41eebc5-a813-487e-bcc2-698fa1029a0f-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:49 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9
Nov 05 18:45:49 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:49 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9" returned: 0 in 0.460s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:49 devstack sudo[101938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9
Nov 05 18:45:49 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:49 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52991274-4f7a-4017-845b-dcc130c3abf9" returned: 0 in 0.341s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-52991274-4f7a-4017-845b-dcc130c3abf9" released by "delete_volume" :: held 0.863s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Created reservations ['94a31cbd-3298-4adc-a930-627a276ef0e3', '59f6bc5e-c78e-45a3-a399-487b415bb59e', '659e6d71-de76-4182-923e-f1ac965dd715', 'bcd17e1f-4303-47f1-a321-3fd31f012ea3'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:49 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:49 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Creating offline snapshot 247f655f-64d5-4da1-b84a-9f03f8fe8e74 of volume cd4b3190-4733-4375-bd8f-9d5228cd46de {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0fef3c-9920-425d-9a04-576625d2e17c]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:50 devstack sudo[101943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de
Nov 05 18:45:50 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:50 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.382s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:45:50 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Deleted volume successfully.
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-fb75823d-448b-4ee7-9997-0be400e1e124 tempest-VolumesGetTest-145729097 None] Lock "cinder-52991274-4f7a-4017-845b-dcc130c3abf9-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:50 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de" returned: 0 in 0.431s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:50 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74 1G
Nov 05 18:45:50 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (2eedddf9-4099-48f8-9305-68c037f054b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c240dc-22f7-4f72-922e-1a05640caa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c240dc-22f7-4f72-922e-1a05640caa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1115747155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f82bbf-641e-4807-9e28-3c44216fbfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:51Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefadbad-9fb0-48fd-a2ad-0f3e8fbe76aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefadbad-9fb0-48fd-a2ad-0f3e8fbe76aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922ab245-6751-421e-851d-88e528289504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922ab245-6751-421e-851d-88e528289504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f82bbf-641e-4807-9e28-3c44216fbfb2', 'volume_name': 'volume-92f82bbf-641e-4807-9e28-3c44216fbfb2', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e42804-560e-47b7-9b7a-749f0cf0a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e42804-560e-47b7-9b7a-749f0cf0a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89568e64-bef8-4cb4-9931-0c9137ba9fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:50 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Volume 92f82bbf-641e-4807-9e28-3c44216fbfb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f82bbf-641e-4807-9e28-3c44216fbfb2', 'volume_size': 1}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:50 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74 1G" returned: 0 in 0.471s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd4b3190-4733-4375-bd8f-9d5228cd46de -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:50 devstack sudo[101955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd4b3190-4733-4375-bd8f-9d5228cd46de -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74
Nov 05 18:45:50 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:51 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd4b3190-4733-4375-bd8f-9d5228cd46de -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74" returned: 0 in 0.300s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:51 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74 is being set with open permissions: ugo+rw
Nov 05 18:45:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:51 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74
Nov 05 18:45:51 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:51 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74" returned: 0 in 0.250s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:51 devstack sudo[101963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.info
Nov 05 18:45:51 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:51 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.info" returned: 0 in 0.337s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:51 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.info is being set with open permissions: ugo+rw
Nov 05 18:45:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:51 devstack sudo[101966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.info
Nov 05 18:45:51 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:52 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.info" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1115747155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f82bbf-641e-4807-9e28-3c44216fbfb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:51Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Creating volume 92f82bbf-641e-4807-9e28-3c44216fbfb2 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:52 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:52 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 1073741824
Nov 05 18:45:52 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:52 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8630f38c-7247-41da-ac08-9bf9b89c69f8 tempest-SnapshotMetadataTestJSON-941601504 None] Create snapshot completed successfully
Nov 05 18:45:52 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 1073741824" returned: 0 in 0.554s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:52 devstack sudo[101982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2
Nov 05 18:45:52 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:53 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2" returned: 0 in 0.262s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89568e64-bef8-4cb4-9931-0c9137ba9fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f82bbf-641e-4807-9e28-3c44216fbfb2', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd519b1-9efe-4099-b7d3-9aabd34eb816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:53 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Volume volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 (92f82bbf-641e-4807-9e28-3c44216fbfb2): created successfully
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd519b1-9efe-4099-b7d3-9aabd34eb816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (2eedddf9-4099-48f8-9305-68c037f054b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:53 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d28a8e86-589f-411b-9f13-5b65557d4699 tempest-VolumesGetTest-145729097 None] Created volume successfully.
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Flow 'volume_create_manager' (676c8c5b-f8d4-4827-9bdf-9ebe171340e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4f9d49-2693-4505-987e-3d3f00f33272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4f9d49-2693-4505-987e-3d3f00f33272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-627438961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97e726c-2111-48c8-b86a-6caf2c988e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8539a72f9d5540f388c21626d9b5befc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=12074e90-2454-46f2-b1f6-fe3355a98fc3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:54Z,use_quota=True,user_id='572d0a2125f9476bb66f849337151377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4503b5-cf54-412f-b26a-ecac2140cb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4503b5-cf54-412f-b26a-ecac2140cb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469d7e37-d658-4beb-a1de-0985ed5efba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469d7e37-d658-4beb-a1de-0985ed5efba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a97e726c-2111-48c8-b86a-6caf2c988e85', 'volume_name': 'volume-a97e726c-2111-48c8-b86a-6caf2c988e85', 'volume_size': 1, 'snapshot_id': '12074e90-2454-46f2-b1f6-fe3355a98fc3'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31f6a65-f2a8-4820-a62e-1424094aa67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31f6a65-f2a8-4820-a62e-1424094aa67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce6333c-3462-4f0c-9633-ca4efb8ca8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:53 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Volume a97e726c-2111-48c8-b86a-6caf2c988e85: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a97e726c-2111-48c8-b86a-6caf2c988e85', 'volume_size': 1, 'snapshot_id': '12074e90-2454-46f2-b1f6-fe3355a98fc3'}
Nov 05 18:45:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Acquiring lock "cinder-247f655f-64d5-4da1-b84a-9f03f8fe8e74-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Acquiring lock "cinder-quobyte-12074e90-2454-46f2-b1f6-fe3355a98fc3-a97e726c-2111-48c8-b86a-6caf2c988e85" by "_create_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Lock "cinder-247f655f-64d5-4da1-b84a-9f03f8fe8e74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Acquiring lock "cinder-quobyte-cd4b3190-4733-4375-bd8f-9d5228cd46de" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-12074e90-2454-46f2-b1f6-fe3355a98fc3-a97e726c-2111-48c8-b86a-6caf2c988e85" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Creating volume a97e726c-2111-48c8-b86a-6caf2c988e85 from snapshot 12074e90-2454-46f2-b1f6-fe3355a98fc3 {{(pid=87086) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Acquiring lock "cinder-quobyte-a97e726c-2111-48c8-b86a-6caf2c988e85" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Lock "cinder-quobyte-cd4b3190-4733-4375-bd8f-9d5228cd46de" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Acquiring lock "cinder-quobyte-247f655f-64d5-4da1-b84a-9f03f8fe8e74" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-a97e726c-2111-48c8-b86a-6caf2c988e85" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] snapshot: 12074e90-2454-46f2-b1f6-fe3355a98fc3, volume: a97e726c-2111-48c8-b86a-6caf2c988e85,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Lock "cinder-quobyte-247f655f-64d5-4da1-b84a-9f03f8fe8e74" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Deleting offline snapshot 247f655f-64d5-4da1-b84a-9f03f8fe8e74 of volume cd4b3190-4733-4375-bd8f-9d5228cd46de {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] snapshot_file for this snap is: volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0f4735-f06f-4ec3-b589-fd7684cbead7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5107c9-4baf-49f6-a333-044ab36c45e8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:54 devstack sudo[101985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74
Nov 05 18:45:54 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:54 devstack sudo[101986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3
Nov 05 18:45:54 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (0c409fd9-6c49-48af-969a-78e894ffc664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052b82b6-ff16-4b88-b5fe-75a53e0e85af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052b82b6-ff16-4b88-b5fe-75a53e0e85af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-768532144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f641dd73-e44f-4c53-b81b-51910d0461a2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=92f82bbf-641e-4807-9e28-3c44216fbfb2,status='creating',terminated_at=None,updated_at=2026-11-05T17:45:55Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8776a737-925f-4378-98c6-5f15f36c583e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:54 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8776a737-925f-4378-98c6-5f15f36c583e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd8986b-6278-4acf-a285-00acf8026604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74" returned: 0 in 0.537s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd4b3190-4733-4375-bd8f-9d5228cd46de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:45:54 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3" returned: 0 in 0.489s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a57c806-148a-4233-b20b-03c8bc5218da]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd8986b-6278-4acf-a285-00acf8026604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f641dd73-e44f-4c53-b81b-51910d0461a2', 'volume_name': 'volume-f641dd73-e44f-4c53-b81b-51910d0461a2', 'volume_size': 1, 'source_volid': '92f82bbf-641e-4807-9e28-3c44216fbfb2', 'source_volstatus': 'available'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ff5faa-83b9-4c37-afd4-ff04eaee1046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ff5faa-83b9-4c37-afd4-ff04eaee1046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f100088b-56d4-448f-8994-ad9b2ce323e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:45:54 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Volume f641dd73-e44f-4c53-b81b-51910d0461a2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f641dd73-e44f-4c53-b81b-51910d0461a2', 'volume_size': 1, 'source_volid': '92f82bbf-641e-4807-9e28-3c44216fbfb2', 'source_volstatus': 'available'}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafd07a9-15de-44b0-a18e-d08d94fe0d4f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:54 devstack sudo[101996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de
Nov 05 18:45:54 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:54 devstack sudo[101997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861
Nov 05 18:45:54 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:55 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de" returned: 0 in 0.471s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:55 devstack sudo[102009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74
Nov 05 18:45:55 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:55 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861" returned: 0 in 0.482s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:45:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:45:55 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85 not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:45:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:55 devstack sudo[102011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85
Nov 05 18:45:55 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:55 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74" returned: 0 in 0.425s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:55 devstack sudo[102022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74
Nov 05 18:45:55 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:55 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de.247f655f-64d5-4da1-b84a-9f03f8fe8e74" returned: 0 in 0.345s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Lock "cinder-quobyte-247f655f-64d5-4da1-b84a-9f03f8fe8e74" released by "_delete_snapshot" :: held 1.967s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Lock "cinder-quobyte-cd4b3190-4733-4375-bd8f-9d5228cd46de" released by "delete_snapshot" :: held 2.017s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:56 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Created reservations ['6e30791f-eabd-4c17-a0f3-5bb4e30d5d42', 'fd9e4c61-bcfa-4633-a0bd-aa4fa94453ed', '053e0f4b-28f0-415b-a8e9-bdefc92e5279', '81ee4d61-8509-45e3-8914-d9b203b12d81'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Delete snapshot completed successfully.
Nov 05 18:45:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-434bf588-4a5f-415b-b3e9-5c81eceb260d tempest-SnapshotMetadataTestJSON-941601504 None] Lock "cinder-247f655f-64d5-4da1-b84a-9f03f8fe8e74-delete_snapshot" released by "delete_snapshot" :: held 2.546s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Acquiring lock "cinder-cd4b3190-4733-4375-bd8f-9d5228cd46de-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Lock "cinder-cd4b3190-4733-4375-bd8f-9d5228cd46de-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Acquiring lock "cinder-quobyte-cd4b3190-4733-4375-bd8f-9d5228cd46de" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:45:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Lock "cinder-quobyte-cd4b3190-4733-4375-bd8f-9d5228cd46de" acquired by "delete_volume" :: waited 0.043s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:45:57 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc30ddbc-cdfd-4937-af48-af571d366c48]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:45:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:58 devstack sudo[102033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de
Nov 05 18:45:58 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:58 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de" returned: 0 in 0.983s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:58 devstack sudo[102038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de
Nov 05 18:45:58 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:45:59 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root
Nov 05 18:45:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-cd4b3190-4733-4375-bd8f-9d5228cd46de" returned: 0 in 0.614s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:45:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Lock "cinder-quobyte-cd4b3190-4733-4375-bd8f-9d5228cd46de" released by "delete_volume" :: held 1.803s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:45:59 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Created reservations ['81d649c3-256b-49be-a9c8-234dd950238a', '8db82d4a-5082-4975-ab40-a761bb2ca3e0', 'd32d0117-3227-439b-bc30-fa064f7daff3', '5cc0c390-22c3-4ace-840d-81d3791b559a'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:45:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:45:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:45:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:45:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:45:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:45:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:45:59 devstack sudo[102041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:45:59 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:00 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.718s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:00 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:46:00 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Deleted volume successfully.
Nov 05 18:46:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0466717f-2dd3-46e7-a3f9-ada919773e7b tempest-SnapshotMetadataTestJSON-941601504 None] Lock "cinder-cd4b3190-4733-4375-bd8f-9d5228cd46de-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:05 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85" returned: 0 in 10.475s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:05 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861, size 1024.00 MB, duration 10.48 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:46:05 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Converted 1024.00 MB image at 97.74 MB/s
Nov 05 18:46:05 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85 is being set with open permissions: ugo+rw
Nov 05 18:46:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:05 devstack sudo[102113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85
Nov 05 18:46:05 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:06 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85" returned: 0 in 0.287s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-a97e726c-2111-48c8-b86a-6caf2c988e85" released by "_copy_volume_from_snapshot" :: held 11.966s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-12074e90-2454-46f2-b1f6-fe3355a98fc3-a97e726c-2111-48c8-b86a-6caf2c988e85" released by "_create_volume_from_snapshot" :: held 12.060s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.103s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.298s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:06 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Cloning volume 92f82bbf-641e-4807-9e28-3c44216fbfb2 to volume f641dd73-e44f-4c53-b81b-51910d0461a2
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ce6333c-3462-4f0c-9633-ca4efb8ca8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97e726c-2111-48c8-b86a-6caf2c988e85', 'volume_size': 1, 'snapshot_id': '12074e90-2454-46f2-b1f6-fe3355a98fc3'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b563b100-9158-4f66-aec1-3fe9df8aa1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Creating offline snapshot 50aca12e-d127-4438-90c2-8dd022978d06 of volume 92f82bbf-641e-4807-9e28-3c44216fbfb2 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:46:06 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Volume volume-a97e726c-2111-48c8-b86a-6caf2c988e85 (a97e726c-2111-48c8-b86a-6caf2c988e85): created successfully
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b563b100-9158-4f66-aec1-3fe9df8aa1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Flow 'volume_create_manager' (676c8c5b-f8d4-4827-9bdf-9ebe171340e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cba0dee-bf85-4fa2-96f4-0b6c5af59100]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:06 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2c1a2740-8916-4198-b51e-5455d68a5483 tempest-TestStampPattern-2010350430 None] Created volume successfully.
Nov 05 18:46:06 devstack sudo[102118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2
Nov 05 18:46:06 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:06 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2" returned: 0 in 0.641s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:06 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 1G
Nov 05 18:46:06 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:07 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 1G" returned: 0 in 0.484s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:07 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06
Nov 05 18:46:07 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:07 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06" returned: 0 in 0.334s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:07 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 is being set with open permissions: ugo+rw
Nov 05 18:46:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:07 devstack sudo[102135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06
Nov 05 18:46:07 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:08 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06" returned: 0 in 0.434s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:08 devstack sudo[102138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.info
Nov 05 18:46:08 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:08 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.info" returned: 0 in 0.379s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:08 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.info is being set with open permissions: ugo+rw
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:08 devstack sudo[102141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.info
Nov 05 18:46:08 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:08 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.info" returned: 0 in 0.311s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-quobyte-f641dd73-e44f-4c53-b81b-51910d0461a2" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-f641dd73-e44f-4c53-b81b-51910d0461a2" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] snapshot: 50aca12e-d127-4438-90c2-8dd022978d06, volume: f641dd73-e44f-4c53-b81b-51910d0461a2,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b435a082-b8dc-482e-8151-94cf00cd907f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:09 devstack sudo[102144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06
Nov 05 18:46:09 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:09 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06" returned: 0 in 0.561s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92f82bbf-641e-4807-9e28-3c44216fbfb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:46:09 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde464cc-c3d7-4e7e-9287-33ebb1b7e315]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:09 devstack sudo[102151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2
Nov 05 18:46:09 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:10 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2" returned: 0 in 0.469s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:46:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:46:10 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2 not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:46:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:10 devstack sudo[102157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2
Nov 05 18:46:10 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:18 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=70,cinder:INSERT=25,cinder:UPDATE=80,cinder:DELETE=6 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:46:18 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=68,cinder:UPDATE=61,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:46:20 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2" returned: 0 in 10.142s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2, size 1024.00 MB, duration 10.14 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:46:20 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Converted 1024.00 MB image at 100.96 MB/s
Nov 05 18:46:20 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2 is being set with open permissions: ugo+rw
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:20 devstack sudo[102183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2
Nov 05 18:46:20 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:20 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2" returned: 0 in 0.349s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-f641dd73-e44f-4c53-b81b-51910d0461a2" released by "_copy_volume_from_snapshot" :: held 11.622s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-quobyte-50aca12e-d127-4438-90c2-8dd022978d06" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-50aca12e-d127-4438-90c2-8dd022978d06" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Deleting offline snapshot 50aca12e-d127-4438-90c2-8dd022978d06 of volume 92f82bbf-641e-4807-9e28-3c44216fbfb2 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] snapshot_file for this snap is: volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f107598-e51d-41b0-910e-095af0ffc2b2]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:20 devstack sudo[102186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06
Nov 05 18:46:20 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:21 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06" returned: 0 in 0.391s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92f82bbf-641e-4807-9e28-3c44216fbfb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:46:21 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c14f8a7-6143-47f8-81f1-d3e509755c67]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:21 devstack sudo[102191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2
Nov 05 18:46:21 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:21 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2" returned: 0 in 0.580s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:21 devstack sudo[102196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06
Nov 05 18:46:21 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:22 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06" returned: 0 in 0.483s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:22 devstack sudo[102202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06
Nov 05 18:46:22 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:22 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2.50aca12e-d127-4438-90c2-8dd022978d06" returned: 0 in 0.258s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-50aca12e-d127-4438-90c2-8dd022978d06" released by "_delete_snapshot" :: held 1.847s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.357s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f100088b-56d4-448f-8994-ad9b2ce323e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f641dd73-e44f-4c53-b81b-51910d0461a2', 'volume_size': 1, 'source_volid': '92f82bbf-641e-4807-9e28-3c44216fbfb2', 'source_volstatus': 'available'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb789fa8-61de-498a-a295-3387725be0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:22 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Volume volume-f641dd73-e44f-4c53-b81b-51910d0461a2 (f641dd73-e44f-4c53-b81b-51910d0461a2): created successfully
Nov 05 18:46:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb789fa8-61de-498a-a295-3387725be0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (0c409fd9-6c49-48af-969a-78e894ffc664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:46:22 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c1ebac04-c8b1-4dec-a88d-df64d4cee113 tempest-VolumesGetTest-145729097 None] Created volume successfully.
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Flow 'volume_create_manager' (16019dba-133f-4bab-8a7c-4a12b19477cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bbadf1-a647-47aa-8572-01ba510dc2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bbadf1-a647-47aa-8572-01ba510dc2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1436473363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4354154f-ab8a-4280-acb6-b0e38de8276d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359d1507791447daab36b0a99ec7b2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:46:23Z,use_quota=True,user_id='f3e5267738a1441981b7996516b9b57a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515575cb-2b1a-4029-9bea-0b2c22ddf1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515575cb-2b1a-4029-9bea-0b2c22ddf1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd91282a-7c77-4402-85b2-97fc3e85eaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd91282a-7c77-4402-85b2-97fc3e85eaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4354154f-ab8a-4280-acb6-b0e38de8276d', 'volume_name': 'volume-4354154f-ab8a-4280-acb6-b0e38de8276d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afa107e-711d-4005-ac98-b02522e3d5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afa107e-711d-4005-ac98-b02522e3d5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ee8757-10d8-4ade-8435-722060b3103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Volume 4354154f-ab8a-4280-acb6-b0e38de8276d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4354154f-ab8a-4280-acb6-b0e38de8276d', 'volume_size': 1}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1436473363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4354154f-ab8a-4280-acb6-b0e38de8276d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='359d1507791447daab36b0a99ec7b2fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:46:23Z,use_quota=True,user_id='f3e5267738a1441981b7996516b9b57a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Creating volume 4354154f-ab8a-4280-acb6-b0e38de8276d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:46:23 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:23 devstack sudo[102205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d 1073741824
Nov 05 18:46:23 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (9462248d-ce50-4c7a-a843-3eee3f1f5d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b05e05-c19c-434b-9a4d-4522b861f6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b05e05-c19c-434b-9a4d-4522b861f6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:46:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1981580919',display_name='tempest-VolumesGetTest-Volume-1895857016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b12f188-9833-42f5-9d53-c23db6ea0f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:46:24Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e23181-3f6b-4e09-bcc3-04625edaa1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e23181-3f6b-4e09-bcc3-04625edaa1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf16da9-60af-49eb-9b2e-6be35cb76f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf16da9-60af-49eb-9b2e-6be35cb76f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b12f188-9833-42f5-9d53-c23db6ea0f97', 'volume_name': 'volume-6b12f188-9833-42f5-9d53-c23db6ea0f97', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20937f3-5712-42cb-a65c-7318046439da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20937f3-5712-42cb-a65c-7318046439da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a133b-77c9-4a55-b52b-c0fa573f2aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Volume 6b12f188-9833-42f5-9d53-c23db6ea0f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b12f188-9833-42f5-9d53-c23db6ea0f97', 'volume_size': 1}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:23 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d 1073741824" returned: 0 in 0.475s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:23 devstack sudo[102211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d
Nov 05 18:46:23 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:24 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d" returned: 0 in 0.250s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.323s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:46:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1981580919',display_name='tempest-VolumesGetTest-Volume-1895857016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b12f188-9833-42f5-9d53-c23db6ea0f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:46:24Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Creating volume 6b12f188-9833-42f5-9d53-c23db6ea0f97 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:46:24 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:24 devstack sudo[102214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97 1073741824
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ee8757-10d8-4ade-8435-722060b3103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4354154f-ab8a-4280-acb6-b0e38de8276d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:24 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866cd939-d8fa-4b8e-b616-e6ac787bd794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:24 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Volume volume-4354154f-ab8a-4280-acb6-b0e38de8276d (4354154f-ab8a-4280-acb6-b0e38de8276d): created successfully
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866cd939-d8fa-4b8e-b616-e6ac787bd794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Flow 'volume_create_manager' (16019dba-133f-4bab-8a7c-4a12b19477cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:46:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-29048045-1bdc-45d8-8316-6ba120d38283 tempest-VolumesActionsTest-605971002 None] Created volume successfully.
Nov 05 18:46:24 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97 1073741824" returned: 0 in 0.459s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:24 devstack sudo[102219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97
Nov 05 18:46:24 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:24 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97" returned: 0 in 0.263s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a133b-77c9-4a55-b52b-c0fa573f2aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b12f188-9833-42f5-9d53-c23db6ea0f97', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d708d6-4be7-48c6-bbc7-9c8d6545c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:25 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Volume volume-6b12f188-9833-42f5-9d53-c23db6ea0f97 (6b12f188-9833-42f5-9d53-c23db6ea0f97): created successfully
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d708d6-4be7-48c6-bbc7-9c8d6545c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (9462248d-ce50-4c7a-a843-3eee3f1f5d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:46:25 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3ca58cd4-ecf3-47de-9bcd-96d70d3d8c67 tempest-VolumesGetTest-145729097 None] Created volume successfully.
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:25 devstack sudo[102223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:46:25 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:25 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.317s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:46:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-6b12f188-9833-42f5-9d53-c23db6ea0f97-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Lock "cinder-6b12f188-9833-42f5-9d53-c23db6ea0f97-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-quobyte-6b12f188-9833-42f5-9d53-c23db6ea0f97" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-6b12f188-9833-42f5-9d53-c23db6ea0f97" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9918b90c-76cf-42aa-b381-f5289fc09f7f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:26 devstack sudo[102229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97
Nov 05 18:46:26 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:26 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97" returned: 0 in 0.413s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:26 devstack sudo[102235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97
Nov 05 18:46:26 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:26 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-6b12f188-9833-42f5-9d53-c23db6ea0f97" returned: 0 in 0.255s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-6b12f188-9833-42f5-9d53-c23db6ea0f97" released by "delete_volume" :: held 0.727s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:26 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Created reservations ['9e65be29-9be4-4690-993a-c21fd6a2d1fd', '107e2c66-1c59-4875-b209-15a44bf3668b', '6e25143b-985a-4e4c-8385-2842239973a3', '4b65463a-9760-4e92-b16e-d68f140d095a'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:27 devstack sudo[102238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:46:27 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-f641dd73-e44f-4c53-b81b-51910d0461a2-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Lock "cinder-f641dd73-e44f-4c53-b81b-51910d0461a2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:27 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.319s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:46:27 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Deleted volume successfully.
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c963dba-6ccc-411f-9883-f818cc3a76f3 tempest-VolumesGetTest-145729097 None] Lock "cinder-6b12f188-9833-42f5-9d53-c23db6ea0f97-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-quobyte-f641dd73-e44f-4c53-b81b-51910d0461a2" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-f641dd73-e44f-4c53-b81b-51910d0461a2" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0b37c8-7ec2-4718-a044-a14dff47f587]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:27 devstack sudo[102241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2
Nov 05 18:46:27 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:27 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2" returned: 0 in 0.441s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:27 devstack sudo[102246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2
Nov 05 18:46:27 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:28 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f641dd73-e44f-4c53-b81b-51910d0461a2" returned: 0 in 0.302s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-f641dd73-e44f-4c53-b81b-51910d0461a2" released by "delete_volume" :: held 0.799s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Created reservations ['56697528-11c7-4e91-9b24-0a5b24a41f39', '5a317d6e-cbce-4169-9cf9-94216c868814', 'e78d704a-cded-4cfc-b2a7-03c8f2873649', '819c450a-4884-4222-9d91-2201cf1ecc8b'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:28 devstack sudo[102259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:46:28 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-92f82bbf-641e-4807-9e28-3c44216fbfb2-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Lock "cinder-92f82bbf-641e-4807-9e28-3c44216fbfb2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:28 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.415s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:28 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:46:28 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Deleted volume successfully.
Nov 05 18:46:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-quobyte-92f82bbf-641e-4807-9e28-3c44216fbfb2" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-92f82bbf-641e-4807-9e28-3c44216fbfb2" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:29 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[424e54cf-8313-4e3f-8769-1fb1c265e672]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-642f4aad-c10e-41e0-9328-0ed0d27857a4 tempest-VolumesGetTest-145729097 None] Lock "cinder-f641dd73-e44f-4c53-b81b-51910d0461a2-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:29 devstack sudo[102271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2
Nov 05 18:46:29 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:29 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2" returned: 0 in 0.431s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:29 devstack sudo[102276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2
Nov 05 18:46:29 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:29 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-92f82bbf-641e-4807-9e28-3c44216fbfb2" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-92f82bbf-641e-4807-9e28-3c44216fbfb2" released by "delete_volume" :: held 0.770s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:29 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Created reservations ['830c18c9-396c-41b0-a0a6-87109508225d', '3b396e55-d1c8-40d4-8d1b-3ee3a1136c8d', 'e7ea92d3-37a4-4570-ae59-bf4347d46e1e', 'ed0f25ff-dd6d-42ee-b4b3-215ba02cebf1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:46:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:30 devstack sudo[102280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:46:30 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:30 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.303s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:30 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:46:30 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Deleted volume successfully.
Nov 05 18:46:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d8132e7e-1d13-428e-b3d8-0a728c863818 tempest-VolumesGetTest-145729097 None] Lock "cinder-92f82bbf-641e-4807-9e28-3c44216fbfb2-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (2e4583d5-ae66-44d1-9867-e29ac9170feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbee372-9f9e-46a2-b336-03f3bfbb41af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbee372-9f9e-46a2-b336-03f3bfbb41af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1354693161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54f94df-8bd7-4a28-bdcd-4b5fbd076f89,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:46:32Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67418569-e4af-4ab2-8a03-83f9305f72ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67418569-e4af-4ab2-8a03-83f9305f72ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483c64dc-78d0-43b7-84e0-ce56c409594c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.image.glance [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Creating Keystone auth plugin from conf {{(pid=87086) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483c64dc-78d0-43b7-84e0-ce56c409594c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c54f94df-8bd7-4a28-bdcd-4b5fbd076f89', 'volume_name': 'volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf46e8050>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569b1d87-b385-4aa7-beb3-46c93f55efc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569b1d87-b385-4aa7-beb3-46c93f55efc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d38c3b3-4e99-44d7-a72d-6d7f1ebba1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:32 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Volume c54f94df-8bd7-4a28-bdcd-4b5fbd076f89: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf46e8050>}
Nov 05 18:46:32 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Trying to clone c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 from image f12bcbef-da90-40ac-bcfe-4218bc9aa565 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]). {{(pid=87086) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c14e6f96-75e2-470b-a9a3-9cd4458f720e tempest-VolumesActionsTest-605971002 None] Acquiring lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d" by "attach_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c14e6f96-75e2-470b-a9a3-9cd4458f720e tempest-VolumesActionsTest-605971002 None] Lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d" acquired by "attach_volume" :: waited 0.047s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 18:46:33 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76bdaee-c58d-4658-a2c5-1d9bdcf17d85]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c14e6f96-75e2-470b-a9a3-9cd4458f720e tempest-VolumesActionsTest-605971002 None] Attaching volume 4354154f-ab8a-4280-acb6-b0e38de8276d to instance a74448f7-5177-461b-a59c-ea27d609b38a at mountpoint /dev/vdb on host None.
Nov 05 18:46:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c14e6f96-75e2-470b-a9a3-9cd4458f720e tempest-VolumesActionsTest-605971002 None] Attach volume completed successfully.
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c14e6f96-75e2-470b-a9a3-9cd4458f720e tempest-VolumesActionsTest-605971002 None] Lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d" released by "attach_volume" :: held 0.230s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:33 devstack sudo[102353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD
Nov 05 18:46:33 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-79f7967b-8b40-457a-94b8-3aecfc5721e2 tempest-VolumesActionsTest-605971002 None] Acquiring lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d-detach_volume" by "detach_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-79f7967b-8b40-457a-94b8-3aecfc5721e2 tempest-VolumesActionsTest-605971002 None] Lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-79f7967b-8b40-457a-94b8-3aecfc5721e2 tempest-VolumesActionsTest-605971002 None] Detaching volume 4354154f-ab8a-4280-acb6-b0e38de8276d from instance a74448f7-5177-461b-a59c-ea27d609b38a.
Nov 05 18:46:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-79f7967b-8b40-457a-94b8-3aecfc5721e2 tempest-VolumesActionsTest-605971002 None] Detach volume completed successfully.
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-79f7967b-8b40-457a-94b8-3aecfc5721e2 tempest-VolumesActionsTest-605971002 None] Lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d-detach_volume" released by "detach_volume" :: held 0.119s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:33 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:33 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Temporary image f12bcbef-da90-40ac-bcfe-4218bc9aa565 is fetched for user da4b5feccd8a475aa1897f403aadf5b8. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[674018d1-78c4-4571-8c1b-1ede729e7d5e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:34 devstack sudo[102359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD
Nov 05 18:46:34 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:34 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1354693161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54f94df-8bd7-4a28-bdcd-4b5fbd076f89,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:46:32Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Creating volume c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:46:34 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:46:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:34 devstack sudo[102372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 1073741824
Nov 05 18:46:34 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:35 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 1073741824" returned: 0 in 0.553s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:35 devstack sudo[102393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89
Nov 05 18:46:35 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:35 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89" returned: 0 in 0.286s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:46:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:35 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Attempting download of f12bcbef-da90-40ac-bcfe-4218bc9aa565 ((None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}])) to volume c54f94df-8bd7-4a28-bdcd-4b5fbd076f89. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 18:46:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b948a5-bd5a-4c34-91d9-8028a6c84109]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_s6htnh_a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:35 devstack sudo[102398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_s6htnh_a
Nov 05 18:46:35 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:35 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_s6htnh_a" returned: 0 in 0.376s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_s6htnh_a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:36 devstack sudo[102403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_s6htnh_a
Nov 05 18:46:36 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:36 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_s6htnh_a" returned: 1 in 0.348s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f12bcbef-da90-40ac-bcfe-4218bc9aa565_s6htnh_a' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:46:36 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14b3305-190e-4425-bb4c-f81e19a9782e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:36 devstack sudo[102407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD
Nov 05 18:46:36 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:36 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:36 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] f12bcbef-da90-40ac-bcfe-4218bc9aa565 was qcow2, converting to qcow2 {{(pid=87086) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 18:46:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:36 devstack sudo[102412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89
Nov 05 18:46:36 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:38 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89" returned: 0 in 2.166s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:38 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f12bcbef-da90-40ac-bcfe-4218bc9aa565_aeil3brudevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:46:38 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Converted 112.00 MB image at 51.69 MB/s
Nov 05 18:46:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:38 devstack sudo[102425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 1G
Nov 05 18:46:38 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:39 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 1G" returned: 0 in 0.378s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:39 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Downloaded image f12bcbef-da90-40ac-bcfe-4218bc9aa565 ((None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}])) to volume c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 successfully. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 18:46:39 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Temporary image f12bcbef-da90-40ac-bcfe-4218bc9aa565 for user da4b5feccd8a475aa1897f403aadf5b8 is deleted. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 18:46:39 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Marking volume c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 as bootable. {{(pid=87086) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 18:46:39 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Copying metadata from image f12bcbef-da90-40ac-bcfe-4218bc9aa565 to c54f94df-8bd7-4a28-bdcd-4b5fbd076f89. {{(pid=87086) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 18:46:39 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Creating volume glance metadata for volume c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 backed by image f12bcbef-da90-40ac-bcfe-4218bc9aa565 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87086) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 18:46:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d38c3b3-4e99-44d7-a72d-6d7f1ebba1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89', 'volume_size': 1, 'image_id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '17b54e14bdfb448393335f4bdd431f4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f12bcbef-da90-40ac-bcfe-4218bc9aa565', 'created_at': datetime.datetime(2026, 11, 5, 17, 27, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 27, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f12bcbef-da90-40ac-bcfe-4218bc9aa565/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf46e8050>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e273a616-e3f5-4fcb-a246-adab3ad3df52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:39 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Volume volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 (c54f94df-8bd7-4a28-bdcd-4b5fbd076f89): created successfully
Nov 05 18:46:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e273a616-e3f5-4fcb-a246-adab3ad3df52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (2e4583d5-ae66-44d1-9867-e29ac9170feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:46:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fe6f34d9-71de-44b1-8716-db877d07159d tempest-VolumesGetTest-145729097 None] Created volume successfully.
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (3fa40db6-0177-4683-9da7-a0c633818577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a89e3b-beef-4d44-a9a7-3c23cf9405d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a89e3b-beef-4d44-a9a7-3c23cf9405d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:46:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1884416108',display_name='tempest-VolumesGetTest-Volume-1850055817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb972791-a3df-4246-bc95-952830942616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:46:41Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa650ca-d733-4f95-acb8-4f3ab95183ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa650ca-d733-4f95-acb8-4f3ab95183ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d342491-672d-4cec-884f-6c9a01ebe9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d342491-672d-4cec-884f-6c9a01ebe9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb972791-a3df-4246-bc95-952830942616', 'volume_name': 'volume-eb972791-a3df-4246-bc95-952830942616', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edac1508-66fb-4be9-8a83-d1b5aa48fe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edac1508-66fb-4be9-8a83-d1b5aa48fe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ead788d-8c75-424b-bcb8-d84644f13dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:40 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Volume eb972791-a3df-4246-bc95-952830942616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb972791-a3df-4246-bc95-952830942616', 'volume_size': 1}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:46:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1884416108',display_name='tempest-VolumesGetTest-Volume-1850055817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb972791-a3df-4246-bc95-952830942616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2a010913434af492842923cf0d60e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:46:41Z,use_quota=True,user_id='da4b5feccd8a475aa1897f403aadf5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Creating volume eb972791-a3df-4246-bc95-952830942616 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:46:40 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:46:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:40 devstack sudo[102447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616 1073741824
Nov 05 18:46:40 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:41 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616 1073741824" returned: 0 in 0.480s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:41 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616
Nov 05 18:46:41 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:41 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616" returned: 0 in 0.255s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:46:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ead788d-8c75-424b-bcb8-d84644f13dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb972791-a3df-4246-bc95-952830942616', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4572772-c0a2-45dd-8293-c8270c19c133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:46:41 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Volume volume-eb972791-a3df-4246-bc95-952830942616 (eb972791-a3df-4246-bc95-952830942616): created successfully
Nov 05 18:46:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4572772-c0a2-45dd-8293-c8270c19c133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:46:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Flow 'volume_create_manager' (3fa40db6-0177-4683-9da7-a0c633818577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:46:41 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0b70e66c-b27d-4f57-a068-4e61df9935a1 tempest-VolumesGetTest-145729097 None] Created volume successfully.
Nov 05 18:46:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-eb972791-a3df-4246-bc95-952830942616-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Lock "cinder-eb972791-a3df-4246-bc95-952830942616-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-quobyte-eb972791-a3df-4246-bc95-952830942616" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-eb972791-a3df-4246-bc95-952830942616" acquired by "delete_volume" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:42 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[07be1cdb-4075-4d2a-9596-5d8c70ee5577]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:43 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616
Nov 05 18:46:43 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:43 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616" returned: 0 in 0.419s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:43 devstack sudo[102533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616
Nov 05 18:46:43 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:43 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eb972791-a3df-4246-bc95-952830942616" returned: 0 in 0.271s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-eb972791-a3df-4246-bc95-952830942616" released by "delete_volume" :: held 0.733s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Created reservations ['4ec6e79f-9d3c-4ed0-a7a2-3d58fd0c2371', 'd0641e7f-e655-4523-822c-2fb70fff2957', '2069f3c7-6d1a-4258-96b1-0335a3cfa56f', '63ccfa8c-6f7d-4980-b4f2-cfd41324c35d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:43 devstack sudo[102536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:46:43 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:44 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-82d1477c-3fed-4739-b492-c767355f1bec tempest-VolumesActionsTest-605971002 None] Acquiring lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d" by "attach_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.286s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:46:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Deleted volume successfully.
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-82d1477c-3fed-4739-b492-c767355f1bec tempest-VolumesActionsTest-605971002 None] Lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d" acquired by "attach_volume" :: waited 0.042s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4cc5bd92-7c60-4df4-a59e-d88a7775483b tempest-VolumesGetTest-145729097 None] Lock "cinder-eb972791-a3df-4246-bc95-952830942616-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-82d1477c-3fed-4739-b492-c767355f1bec tempest-VolumesActionsTest-605971002 None] Attaching volume 4354154f-ab8a-4280-acb6-b0e38de8276d to instance fcb30ca2-c71d-4428-97cf-b00fd13247c6 at mountpoint /dev/vdb on host None.
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Lock "cinder-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-82d1477c-3fed-4739-b492-c767355f1bec tempest-VolumesActionsTest-605971002 None] Attach volume completed successfully.
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-82d1477c-3fed-4739-b492-c767355f1bec tempest-VolumesActionsTest-605971002 None] Lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d" released by "attach_volume" :: held 0.128s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Acquiring lock "cinder-quobyte-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f139290-08e3-48ad-b932-fe3fb35ff762]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:44 devstack sudo[102539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89
Nov 05 18:46:44 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cc5ae0dc-bef7-4ee3-8ded-866ca8fa801c tempest-VolumesActionsTest-605971002 None] Acquiring lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d-detach_volume" by "detach_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cc5ae0dc-bef7-4ee3-8ded-866ca8fa801c tempest-VolumesActionsTest-605971002 None] Lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:46:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-cc5ae0dc-bef7-4ee3-8ded-866ca8fa801c tempest-VolumesActionsTest-605971002 None] Detaching volume 4354154f-ab8a-4280-acb6-b0e38de8276d from instance fcb30ca2-c71d-4428-97cf-b00fd13247c6.
Nov 05 18:46:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-cc5ae0dc-bef7-4ee3-8ded-866ca8fa801c tempest-VolumesActionsTest-605971002 None] Detach volume completed successfully.
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cc5ae0dc-bef7-4ee3-8ded-866ca8fa801c tempest-VolumesActionsTest-605971002 None] Lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:44 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89" returned: 0 in 0.453s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:44 devstack sudo[102545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89
Nov 05 18:46:44 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:45 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89" returned: 0 in 0.356s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Lock "cinder-quobyte-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89" released by "delete_volume" :: held 0.866s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Created reservations ['e91f6a3b-b6fb-409c-9827-408bc5416c1a', '1e54bf21-e243-402d-93dd-9696058d639f', 'b3aa9317-77f9-44fe-9cbf-80f7e78c1030', '38bdcc10-383b-444e-a222-7afd16d5a3ea'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:45 devstack sudo[102570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:46:45 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:45 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.270s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:46:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Deleted volume successfully.
Nov 05 18:46:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0603fbc8-9e93-4c4b-a21f-81ad674691fb tempest-VolumesGetTest-145729097 None] Lock "cinder-c54f94df-8bd7-4a28-bdcd-4b5fbd076f89-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:46:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:46:49 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5aebec-4927-46ea-a446-833cfc3664e2]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:49 devstack sudo[102601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d
Nov 05 18:46:49 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:49 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d" returned: 0 in 0.439s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:49 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15f6304-e459-4333-8542-d61c434ca8d3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:49 devstack sudo[102628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d
Nov 05 18:46:49 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-cac7c71f-c83c-4503-a58a-7b353c69277b req-e409351e-08b5-4521-b357-f278c895f470 tempest-TestStampPattern-2010350430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:46:50 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d" returned: 0 in 0.448s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.5efbbb53-df5f-49a5-a105-c27115beb445t9vron06.img {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:50 devstack sudo[102642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.5efbbb53-df5f-49a5-a105-c27115beb445t9vron06.img
Nov 05 18:46:50 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:57 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.5efbbb53-df5f-49a5-a105-c27115beb445t9vron06.img" returned: 0 in 6.801s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:57 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dd3855-9106-47dc-b95f-32335454b8a7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:46:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:46:57 devstack sudo[102673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d
Nov 05 18:46:57 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:46:57 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root
Nov 05 18:46:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d" returned: 0 in 0.646s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:46:57 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.5efbbb53-df5f-49a5-a105-c27115beb445t9vron06.img {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:46:57 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Converted 1024.00 MB image at 150.52 MB/s
Nov 05 18:46:57 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] 5efbbb53-df5f-49a5-a105-c27115beb445 was raw, no need to convert to raw {{(pid=87086) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 18:47:07 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=67,cinder:SELECT=64,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:47:07 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=59,cinder:DELETE=6,cinder:SELECT=50,cinder:INSERT=22 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Flow 'volume_create_manager' (a300557b-f3f8-46fa-ac22-4979b29ca621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71cd7e2-10cf-4337-80ce-ece6b9dd5c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71cd7e2-10cf-4337-80ce-ece6b9dd5c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1393815070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2afa3c-993b-43e6-8397-125b8ab7c7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81783cedf0fb4bb68394df7ab3d61ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:47:17Z,use_quota=True,user_id='cbf4cd2e491e4b8ea09ffd8d3602e2c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58294751-46c8-4ab8-99d0-ac92be40f427),volume_type_id=58294751-46c8-4ab8-99d0-ac92be40f427)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220f152e-3cd3-4f5b-b27c-b1b3824d95e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220f152e-3cd3-4f5b-b27c-b1b3824d95e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4d0918-342e-46b8-9d56-cca41315146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4d0918-342e-46b8-9d56-cca41315146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f2afa3c-993b-43e6-8397-125b8ab7c7de', 'volume_name': 'volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8338ca6f-6505-4f88-963c-29f4c5eeceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8338ca6f-6505-4f88-963c-29f4c5eeceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10d2760-6285-4ac6-b68c-c285ff030b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:17 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Volume 3f2afa3c-993b-43e6-8397-125b8ab7c7de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de', 'volume_size': 1}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Flow 'volume_create_manager' (4e03e1d9-d40f-471d-890b-62a2e29d729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c765c3-60ee-4144-91eb-63621dfefceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c765c3-60ee-4144-91eb-63621dfefceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-336243946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5add442-90b7-493b-bbec-6952955dccf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81783cedf0fb4bb68394df7ab3d61ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:47:18Z,use_quota=True,user_id='cbf4cd2e491e4b8ea09ffd8d3602e2c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c229f7c-d61e-4c0d-bfd3-1df4ad7e59ec),volume_type_id=9c229f7c-d61e-4c0d-bfd3-1df4ad7e59ec)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ee2f6f-ccce-4943-9a3d-52cf62e7cebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ee2f6f-ccce-4943-9a3d-52cf62e7cebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d2f738-bfed-4728-8e28-3c2f451c2571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d2f738-bfed-4728-8e28-3c2f451c2571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5add442-90b7-493b-bbec-6952955dccf9', 'volume_name': 'volume-e5add442-90b7-493b-bbec-6952955dccf9', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae8eccd-feef-49c9-93e8-93f7a2e8622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae8eccd-feef-49c9-93e8-93f7a2e8622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d66746-0380-478d-b086-448571797034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:17 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Volume e5add442-90b7-493b-bbec-6952955dccf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5add442-90b7-493b-bbec-6952955dccf9', 'volume_size': 1}
Nov 05 18:47:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:18 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:47:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Flow 'volume_create_manager' (2ff35656-0554-460f-ad47-4975754f2e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:47:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ecd4bb-d8b6-42fd-97e6-3803a53b0474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ecd4bb-d8b6-42fd-97e6-3803a53b0474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-274129378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e48e7a-3acc-4448-9db9-646aebc47d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81783cedf0fb4bb68394df7ab3d61ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:47:19Z,use_quota=True,user_id='cbf4cd2e491e4b8ea09ffd8d3602e2c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6e94b00-6660-477c-a579-df490b9fb965),volume_type_id=e6e94b00-6660-477c-a579-df490b9fb965)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226d8ed-b689-4275-a89a-bf5d00959db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d226d8ed-b689-4275-a89a-bf5d00959db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850e1a9a-a9ca-4e4e-8181-c4dc69b42e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:18 devstack cinder-volume[87086]: DEBUG cinder.image.glance [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Creating Keystone auth plugin from conf {{(pid=87086) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 18:47:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850e1a9a-a9ca-4e4e-8181-c4dc69b42e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2e48e7a-3acc-4448-9db9-646aebc47d3a', 'volume_name': 'volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a', 'volume_size': 1, 'image_id': '36beabe9-7245-4ab5-9eb4-077136bef48b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36beabe9-7245-4ab5-9eb4-077136bef48b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--759392546', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81783cedf0fb4bb68394df7ab3d61ed2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36beabe9-7245-4ab5-9eb4-077136bef48b', 'created_at': datetime.datetime(2026, 11, 5, 17, 47, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 47, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36beabe9-7245-4ab5-9eb4-077136bef48b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea2b1b20>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67401cbd-0a5f-4ef5-bde8-82d8d70c802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67401cbd-0a5f-4ef5-bde8-82d8d70c802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe05fb6b-ff98-4cee-8616-451f3d7b4a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:19 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Volume b2e48e7a-3acc-4448-9db9-646aebc47d3a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a', 'volume_size': 1, 'image_id': '36beabe9-7245-4ab5-9eb4-077136bef48b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36beabe9-7245-4ab5-9eb4-077136bef48b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--759392546', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81783cedf0fb4bb68394df7ab3d61ed2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36beabe9-7245-4ab5-9eb4-077136bef48b', 'created_at': datetime.datetime(2026, 11, 5, 17, 47, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 47, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36beabe9-7245-4ab5-9eb4-077136bef48b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea2b1b20>}
Nov 05 18:47:19 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Trying to clone b2e48e7a-3acc-4448-9db9-646aebc47d3a from image 36beabe9-7245-4ab5-9eb4-077136bef48b at location (None, [{'url': 'file:///opt/stack/data/glance/images/36beabe9-7245-4ab5-9eb4-077136bef48b', 'metadata': {}}]). {{(pid=87086) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.740s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Uploaded volume to glance image-id: 5efbbb53-df5f-49a5-a105-c27115beb445. {{(pid=87086) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-cac7c71f-c83c-4503-a58a-7b353c69277b req-e409351e-08b5-4521-b357-f278c895f470 tempest-TestStampPattern-2010350430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 29.851s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-cac7c71f-c83c-4503-a58a-7b353c69277b req-e409351e-08b5-4521-b357-f278c895f470 tempest-TestStampPattern-2010350430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.523s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1393815070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f2afa3c-993b-43e6-8397-125b8ab7c7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81783cedf0fb4bb68394df7ab3d61ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:47:17Z,use_quota=True,user_id='cbf4cd2e491e4b8ea09ffd8d3602e2c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58294751-46c8-4ab8-99d0-ac92be40f427),volume_type_id=58294751-46c8-4ab8-99d0-ac92be40f427)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Creating volume 3f2afa3c-993b-43e6-8397-125b8ab7c7de {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:47:20 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:20 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-96ac1eb3-a998-42a9-9447-32f36db71b1b tempest-VolumesActionsTest-605971002 None] Copy volume to image completed successfully.
Nov 05 18:47:20 devstack sudo[102682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de 1073741824
Nov 05 18:47:20 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-cac7c71f-c83c-4503-a58a-7b353c69277b req-e409351e-08b5-4521-b357-f278c895f470 tempest-TestStampPattern-2010350430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-a97e726c-2111-48c8-b86a-6caf2c988e85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27e97fa9-52ce-4f1c-957b-f1145939751c', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:47:20 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-cac7c71f-c83c-4503-a58a-7b353c69277b req-e409351e-08b5-4521-b357-f278c895f470 tempest-TestStampPattern-2010350430 None] attachment_update completed successfully.
Nov 05 18:47:20 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de 1073741824" returned: 0 in 0.552s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:20 devstack sudo[103103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de
Nov 05 18:47:20 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:20 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de" returned: 0 in 0.307s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-336243946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5add442-90b7-493b-bbec-6952955dccf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81783cedf0fb4bb68394df7ab3d61ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:47:18Z,use_quota=True,user_id='cbf4cd2e491e4b8ea09ffd8d3602e2c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c229f7c-d61e-4c0d-bfd3-1df4ad7e59ec),volume_type_id=9c229f7c-d61e-4c0d-bfd3-1df4ad7e59ec)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Creating volume e5add442-90b7-493b-bbec-6952955dccf9 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:47:21 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10d2760-6285-4ac6-b68c-c285ff030b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:21 devstack sudo[103106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9 1073741824
Nov 05 18:47:21 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc17b58c-d183-451c-bf6b-d9d7f8025b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:21 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Volume volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de (3f2afa3c-993b-43e6-8397-125b8ab7c7de): created successfully
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc17b58c-d183-451c-bf6b-d9d7f8025b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Flow 'volume_create_manager' (a300557b-f3f8-46fa-ac22-4979b29ca621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:47:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f96b67f7-3e9b-4071-bdec-26eaf2df463b tempest-TestInstancesWithCinderVolumes-1445035719 None] Created volume successfully.
Nov 05 18:47:21 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9 1073741824" returned: 0 in 0.560s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:21 devstack sudo[103112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9
Nov 05 18:47:21 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:21 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9" returned: 0 in 0.275s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d66746-0380-478d-b086-448571797034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5add442-90b7-493b-bbec-6952955dccf9', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99188a44-5176-446c-b38a-2a29063d7393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:21 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Volume volume-e5add442-90b7-493b-bbec-6952955dccf9 (e5add442-90b7-493b-bbec-6952955dccf9): created successfully
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99188a44-5176-446c-b38a-2a29063d7393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Flow 'volume_create_manager' (4e03e1d9-d40f-471d-890b-62a2e29d729b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[818d2dac-6b63-44eb-b546-396ee346e656]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b37a92da-d49b-4ba7-be99-1ac37fd2f897 tempest-TestInstancesWithCinderVolumes-1445035719 None] Created volume successfully.
Nov 05 18:47:22 devstack sudo[103115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d
Nov 05 18:47:22 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:22 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d" returned: 0 in 0.381s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb8fb5e-6bf4-4789-8d84-dc725b8722b0]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:22 devstack sudo[103126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d
Nov 05 18:47:22 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:22 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d" returned: 0 in 0.406s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:22 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img
Nov 05 18:47:22 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:22 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD, size 20.69 MB, duration 3.89 sec {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 18:47:22 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Image download 20.69 MB at 5.32 MB/s
Nov 05 18:47:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bc1a7d-acf9-43d6-9589-a34b6a8468b9]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:23 devstack sudo[103146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD
Nov 05 18:47:23 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:23 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:23 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Temporary image 36beabe9-7245-4ab5-9eb4-077136bef48b is fetched for user cbf4cd2e491e4b8ea09ffd8d3602e2c5. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 18:47:23 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[2127faa0-2822-44f1-b30a-893bef331b40]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:24 devstack sudo[103159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD
Nov 05 18:47:24 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-07094153-0235-4b8f-9828-aaf75d3af05e req-c1b19e5b-48ac-488d-b652-954456abc044 tempest-TestStampPattern-2010350430 None] Terminate volume connection completed successfully.
Nov 05 18:47:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-07094153-0235-4b8f-9828-aaf75d3af05e req-c1b19e5b-48ac-488d-b652-954456abc044 tempest-TestStampPattern-2010350430 None] Deleting attachment 27e97fa9-52ce-4f1c-957b-f1145939751c. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:47:24 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:47:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:47:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:47:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:25 devstack sudo[103192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:47:25 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:26 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.507s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:47:26 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:47:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:47:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:47:30 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img" returned: 0 in 7.615s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:30 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[937f576f-ccd8-4950-8ff6-8f71ee48a6c8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:30 devstack sudo[103225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d
Nov 05 18:47:30 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:30 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d" returned: 0 in 0.515s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:30 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d, size 1024.00 MB, duration 7.62 sec, destination /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:47:30 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Converted 1024.00 MB image at 134.46 MB/s
Nov 05 18:47:30 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] 3f05a0c7-deda-4d0b-9774-fe443b7c9764 was raw, converting to qcow2 {{(pid=87086) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 05 18:47:30 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e8ef43-17ac-4db9-8588-236cabf5137b]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:31 devstack sudo[103230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img
Nov 05 18:47:31 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Acquiring lock "cinder-a97e726c-2111-48c8-b86a-6caf2c988e85-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Lock "cinder-a97e726c-2111-48c8-b86a-6caf2c988e85-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Acquiring lock "cinder-quobyte-a97e726c-2111-48c8-b86a-6caf2c988e85" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-a97e726c-2111-48c8-b86a-6caf2c988e85" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7084cf1-fec8-406e-915a-a44d36aee783]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:31 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img" returned: 0 in 0.354s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:31 devstack sudo[103234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85
Nov 05 18:47:31 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:31 devstack sudo[103235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img
Nov 05 18:47:31 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:31 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85" returned: 0 in 0.369s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:31 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img" returned: 1 in 0.365s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img /opt/stack/data/cinder/conversion/vol_upload_fsm7zjod {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:31 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85
Nov 05 18:47:31 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:31 devstack sudo[103245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img /opt/stack/data/cinder/conversion/vol_upload_fsm7zjod
Nov 05 18:47:31 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:31 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a97e726c-2111-48c8-b86a-6caf2c988e85" returned: 0 in 0.274s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-a97e726c-2111-48c8-b86a-6caf2c988e85" released by "delete_volume" :: held 0.694s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:47:31 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img /opt/stack/data/cinder/conversion/vol_upload_fsm7zjod" returned: 0 in 0.285s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Image conversion details: src /opt/stack/data/cinder/conversion/4354154f-ab8a-4280-acb6-b0e38de8276d.temp_image.3f05a0c7-deda-4d0b-9774-fe443b7c9764r9t8ch_b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fsm7zjod {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:47:31 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4849848-c994-4cbd-8cf1-0e7f6f56777b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fsm7zjod {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:31 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Created reservations ['31d949b9-53ad-40c7-b928-28e18be55370', '480b3621-25a6-46a8-8ca5-f68abdada403', '2df447b2-d2de-42e3-b2da-bada6f5295d5', '29288f0e-6c8a-49b6-87f0-cfcc30af2388'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:47:32 devstack sudo[103252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fsm7zjod
Nov 05 18:47:32 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:32 devstack sudo[103254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:47:32 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:32 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fsm7zjod" returned: 0 in 0.367s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:32 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.287s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:47:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Deleted volume successfully.
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56b14b45-8b9b-48b8-b9d8-121006383c66 tempest-TestStampPattern-2010350430 None] Lock "cinder-a97e726c-2111-48c8-b86a-6caf2c988e85-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Acquiring lock "cinder-12074e90-2454-46f2-b1f6-fe3355a98fc3-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Lock "cinder-12074e90-2454-46f2-b1f6-fe3355a98fc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Acquiring lock "cinder-quobyte-8070c6fe-ee53-4bb5-a008-c6183f8a5861" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-8070c6fe-ee53-4bb5-a008-c6183f8a5861" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Acquiring lock "cinder-quobyte-12074e90-2454-46f2-b1f6-fe3355a98fc3" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-12074e90-2454-46f2-b1f6-fe3355a98fc3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Deleting offline snapshot 12074e90-2454-46f2-b1f6-fe3355a98fc3 of volume 8070c6fe-ee53-4bb5-a008-c6183f8a5861 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] snapshot_file for this snap is: volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fc65bb-55b9-4a44-9d3e-6ee7e5ff3b3a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:32 devstack sudo[103260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3
Nov 05 18:47:32 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:33 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3" returned: 0 in 0.395s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08c5165-98e6-4cf2-a163-27c721ad9057]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:33 devstack sudo[103265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861
Nov 05 18:47:33 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:33 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861" returned: 0 in 0.528s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:33 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3
Nov 05 18:47:33 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.914s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Uploaded volume to glance image-id: 3f05a0c7-deda-4d0b-9774-fe443b7c9764. {{(pid=87086) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.285s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-274129378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2e48e7a-3acc-4448-9db9-646aebc47d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81783cedf0fb4bb68394df7ab3d61ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:47:19Z,use_quota=True,user_id='cbf4cd2e491e4b8ea09ffd8d3602e2c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6e94b00-6660-477c-a579-df490b9fb965),volume_type_id=e6e94b00-6660-477c-a579-df490b9fb965)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Creating volume b2e48e7a-3acc-4448-9db9-646aebc47d3a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:47:33 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:47:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:33 devstack sudo[103272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a 1073741824
Nov 05 18:47:33 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-05b0f8cc-158d-4242-951e-0db98e8d93bd tempest-VolumesActionsTest-605971002 None] Copy volume to image completed successfully.
Nov 05 18:47:34 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3" returned: 0 in 0.390s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:34 devstack sudo[103280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3
Nov 05 18:47:34 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:34 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a 1073741824" returned: 0 in 0.481s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:34 devstack sudo[103285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a
Nov 05 18:47:34 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:34 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861.12074e90-2454-46f2-b1f6-fe3355a98fc3" returned: 0 in 0.276s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-12074e90-2454-46f2-b1f6-fe3355a98fc3" released by "_delete_snapshot" :: held 1.724s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-8070c6fe-ee53-4bb5-a008-c6183f8a5861" released by "delete_snapshot" :: held 1.752s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Created reservations ['6c826766-6173-4576-8d6b-6e2d8768290a', '2eb40c7e-c40a-4039-8cee-f8ee03d20247', '227acf5e-0def-470b-8c9b-a1011662cbdf', '2eff3814-7de9-49fb-a83b-bf2607a12f20'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:47:34 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Delete snapshot completed successfully.
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb6d6bd0-93db-48b7-97f0-e4c93a0f15e2 tempest-TestStampPattern-2010350430 None] Lock "cinder-12074e90-2454-46f2-b1f6-fe3355a98fc3-delete_snapshot" released by "delete_snapshot" :: held 1.955s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:47:34 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a" returned: 0 in 0.272s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Attempting download of 36beabe9-7245-4ab5-9eb4-077136bef48b ((None, [{'url': 'file:///opt/stack/data/glance/images/36beabe9-7245-4ab5-9eb4-077136bef48b', 'metadata': {}}])) to volume b2e48e7a-3acc-4448-9db9-646aebc47d3a. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa7bcc9-23a8-4089-8933-5aac7699b7af]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36beabe9-7245-4ab5-9eb4-077136bef48b_hq648xq9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:34 devstack sudo[103288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36beabe9-7245-4ab5-9eb4-077136bef48b_hq648xq9
Nov 05 18:47:34 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:35 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36beabe9-7245-4ab5-9eb4-077136bef48b_hq648xq9" returned: 0 in 0.400s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36beabe9-7245-4ab5-9eb4-077136bef48b_hq648xq9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:35 devstack sudo[103292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36beabe9-7245-4ab5-9eb4-077136bef48b_hq648xq9
Nov 05 18:47:35 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Acquiring lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Acquiring lock "cinder-quobyte-4354154f-ab8a-4280-acb6-b0e38de8276d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Lock "cinder-quobyte-4354154f-ab8a-4280-acb6-b0e38de8276d" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74053d1-963c-486b-acd7-c82f8f7c569d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:35 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36beabe9-7245-4ab5-9eb4-077136bef48b_hq648xq9" returned: 1 in 0.419s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36beabe9-7245-4ab5-9eb4-077136bef48b_hq648xq9' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f18a4-8480-403c-b6a3-3cf49304daee]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:35 devstack sudo[103295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d
Nov 05 18:47:35 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:35 devstack sudo[103299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD
Nov 05 18:47:35 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:36 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d" returned: 0 in 0.564s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:36 devstack sudo[103308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d
Nov 05 18:47:36 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:36 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] 36beabe9-7245-4ab5-9eb4-077136bef48b was qcow2, converting to qcow2 {{(pid=87086) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:36 devstack sudo[103314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a
Nov 05 18:47:36 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:36 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4354154f-ab8a-4280-acb6-b0e38de8276d" returned: 0 in 0.542s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Lock "cinder-quobyte-4354154f-ab8a-4280-acb6-b0e38de8276d" released by "delete_volume" :: held 1.161s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Created reservations ['49b47b58-031d-4c57-97a2-5c9e4e684903', '1c526379-f8a7-4785-96c8-0e0f28b8a54c', '8a01b535-97cf-42ab-9f2b-7d080d0254b1', 'ea837a27-1afe-43a7-b58b-28d2e49a1756'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:36 devstack sudo[103340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:47:36 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:37 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.325s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:37 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:47:37 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Deleted volume successfully.
Nov 05 18:47:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b84393dc-bc0a-4edf-8669-dc6d8170a349 tempest-VolumesActionsTest-605971002 None] Lock "cinder-4354154f-ab8a-4280-acb6-b0e38de8276d-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:47:38 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a" returned: 0 in 2.533s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:38 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36beabe9-7245-4ab5-9eb4-077136bef48b_dvtqgt4wdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:47:38 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Converted 112.00 MB image at 44.20 MB/s
Nov 05 18:47:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:38 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a 1G
Nov 05 18:47:38 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:39 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a 1G" returned: 0 in 0.378s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Downloaded image 36beabe9-7245-4ab5-9eb4-077136bef48b ((None, [{'url': 'file:///opt/stack/data/glance/images/36beabe9-7245-4ab5-9eb4-077136bef48b', 'metadata': {}}])) to volume b2e48e7a-3acc-4448-9db9-646aebc47d3a successfully. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Temporary image 36beabe9-7245-4ab5-9eb4-077136bef48b for user cbf4cd2e491e4b8ea09ffd8d3602e2c5 is deleted. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Marking volume b2e48e7a-3acc-4448-9db9-646aebc47d3a as bootable. {{(pid=87086) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Acquiring lock "cinder-8070c6fe-ee53-4bb5-a008-c6183f8a5861-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Copying metadata from image 36beabe9-7245-4ab5-9eb4-077136bef48b to b2e48e7a-3acc-4448-9db9-646aebc47d3a. {{(pid=87086) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Creating volume glance metadata for volume b2e48e7a-3acc-4448-9db9-646aebc47d3a backed by image 36beabe9-7245-4ab5-9eb4-077136bef48b with: {'image_id': '36beabe9-7245-4ab5-9eb4-077136bef48b', 'image_name': 'tempest-scenario-img--759392546', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87086) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Lock "cinder-8070c6fe-ee53-4bb5-a008-c6183f8a5861-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Acquiring lock "cinder-quobyte-8070c6fe-ee53-4bb5-a008-c6183f8a5861" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-8070c6fe-ee53-4bb5-a008-c6183f8a5861" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe05fb6b-ff98-4cee-8616-451f3d7b4a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a', 'volume_size': 1, 'image_id': '36beabe9-7245-4ab5-9eb4-077136bef48b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36beabe9-7245-4ab5-9eb4-077136bef48b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--759392546', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '81783cedf0fb4bb68394df7ab3d61ed2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '36beabe9-7245-4ab5-9eb4-077136bef48b', 'created_at': datetime.datetime(2026, 11, 5, 17, 47, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 47, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36beabe9-7245-4ab5-9eb4-077136bef48b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea2b1b20>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9fb3ce-11f3-4ffb-b5bd-d2a2b416263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac20cfc0-8eb1-47e3-9351-2b32b515c6dd]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:39 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Volume volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a (b2e48e7a-3acc-4448-9db9-646aebc47d3a): created successfully
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9fb3ce-11f3-4ffb-b5bd-d2a2b416263f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Flow 'volume_create_manager' (2ff35656-0554-460f-ad47-4975754f2e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:47:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-13184923-0fc3-4664-9966-441ce47b01d9 tempest-TestInstancesWithCinderVolumes-1445035719 None] Created volume successfully.
Nov 05 18:47:39 devstack sudo[103358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861
Nov 05 18:47:39 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:39 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861" returned: 0 in 0.427s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:39 devstack sudo[103363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861
Nov 05 18:47:39 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:40 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8070c6fe-ee53-4bb5-a008-c6183f8a5861" returned: 0 in 0.292s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Lock "cinder-quobyte-8070c6fe-ee53-4bb5-a008-c6183f8a5861" released by "delete_volume" :: held 0.806s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Created reservations ['d8d0b267-94de-415b-b812-71e1141d5a0d', 'ffc1d1be-903d-4a0d-badf-5ed41d7ee95c', '1d827690-9614-44d6-bce1-6482bdb57daa', '20c46954-7232-42a7-a82c-549bcdcad0cf'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:40 devstack sudo[103366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:47:40 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:40 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.295s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:47:40 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Deleted volume successfully.
Nov 05 18:47:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c418767f-11fc-4fe9-8d0c-ed90c4886736 tempest-TestStampPattern-2010350430 None] Lock "cinder-8070c6fe-ee53-4bb5-a008-c6183f8a5861-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:47:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-a6af36df-d250-4de5-a2cf-1d8ca3552a52 req-ecb604d1-4b43-4b02-b278-c502ce98252f tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-a6af36df-d250-4de5-a2cf-1d8ca3552a52 req-ecb604d1-4b43-4b02-b278-c502ce98252f tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-a6af36df-d250-4de5-a2cf-1d8ca3552a52 req-ecb604d1-4b43-4b02-b278-c502ce98252f tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-a6af36df-d250-4de5-a2cf-1d8ca3552a52 req-ecb604d1-4b43-4b02-b278-c502ce98252f tempest-TestInstancesWithCinderVolumes-1445035719 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0121a7e-016c-4181-8dc1-307043ce3743', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:47:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-a6af36df-d250-4de5-a2cf-1d8ca3552a52 req-ecb604d1-4b43-4b02-b278-c502ce98252f tempest-TestInstancesWithCinderVolumes-1445035719 None] attachment_update completed successfully.
Nov 05 18:47:53 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=44,cinder:SELECT=44,cinder:INSERT=17,cinder:DELETE=3 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:47:54 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=52,cinder:UPDATE=45,cinder:DELETE=3,cinder:INSERT=11 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:47:54 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:47:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Flow 'volume_create_manager' (72006d5b-73d8-49b4-bae7-d401993a4dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:47:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ce83de-d5cc-4aad-863e-7e6b9dd4d62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ce83de-d5cc-4aad-863e-7e6b9dd4d62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1218698824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a788bc-16d2-474a-94e0-e01b4d82cc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e480412147348448ef01d6293367694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:47:55Z,use_quota=True,user_id='08be351b584a4e28806563a403b4b6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf85925e-2f97-42a5-8b3d-c261db874885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf85925e-2f97-42a5-8b3d-c261db874885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46837502-6512-4257-98de-690f2fcf4bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46837502-6512-4257-98de-690f2fcf4bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a788bc-16d2-474a-94e0-e01b4d82cc14', 'volume_name': 'volume-67a788bc-16d2-474a-94e0-e01b4d82cc14', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ad198d-eafd-4d37-a42a-2d546325dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ad198d-eafd-4d37-a42a-2d546325dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1772fb-c676-4d78-ae63-0a9bac0b4fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:55 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Volume 67a788bc-16d2-474a-94e0-e01b4d82cc14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a788bc-16d2-474a-94e0-e01b4d82cc14', 'volume_size': 1}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1218698824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a788bc-16d2-474a-94e0-e01b4d82cc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e480412147348448ef01d6293367694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:47:55Z,use_quota=True,user_id='08be351b584a4e28806563a403b4b6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Creating volume 67a788bc-16d2-474a-94e0-e01b4d82cc14 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:47:55 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:55 devstack sudo[103914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14 1073741824
Nov 05 18:47:55 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:55 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14 1073741824" returned: 0 in 0.671s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:47:55 devstack sudo[103920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14
Nov 05 18:47:55 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:47:56 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root
Nov 05 18:47:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:47:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:47:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:47:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1772fb-c676-4d78-ae63-0a9bac0b4fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a788bc-16d2-474a-94e0-e01b4d82cc14', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfcfd7a-9202-4a3e-b288-34b10da4e73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:47:56 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Volume volume-67a788bc-16d2-474a-94e0-e01b4d82cc14 (67a788bc-16d2-474a-94e0-e01b4d82cc14): created successfully
Nov 05 18:47:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfcfd7a-9202-4a3e-b288-34b10da4e73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:47:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Flow 'volume_create_manager' (72006d5b-73d8-49b4-bae7-d401993a4dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:47:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-db252234-33cc-4e25-9032-e9e08091449a tempest-VolumesNegativeTest-426787934 None] Created volume successfully.
Nov 05 18:48:05 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Flow 'volume_create_manager' (5ae6927e-3f08-43e0-b271-305326c8762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bf9bea-89d5-4d86-b07a-7db3eec48443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bf9bea-89d5-4d86-b07a-7db3eec48443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006c2706-ba98-4294-8e3d-491093276197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978c1db92aa544f6976b4e554b498d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:06Z,use_quota=True,user_id='6f7d998472d041a1a89da1e1b99e02ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eceb49d-80cd-4f2f-bff4-a3fc9e66b4cc),volume_type_id=9eceb49d-80cd-4f2f-bff4-a3fc9e66b4cc)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe65bc18-8a1e-4e60-8058-6d87502687be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe65bc18-8a1e-4e60-8058-6d87502687be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c98e9eeb-aeab-4e36-a68f-421901d77dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:05 devstack cinder-volume[87086]: DEBUG cinder.image.glance [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Creating Keystone auth plugin from conf {{(pid=87086) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 18:48:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c98e9eeb-aeab-4e36-a68f-421901d77dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '006c2706-ba98-4294-8e3d-491093276197', 'volume_name': 'volume-006c2706-ba98-4294-8e3d-491093276197', 'volume_size': 1, 'image_id': '7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bd33764845476c0a11e05559f6fcec63', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '978c1db92aa544f6976b4e554b498d76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd0dfa8c5e441576fdf4fcc65f12ecdcf6bc9b650aac9b567dea01c468faf35b093ec273acee549ae02a0f7e1e7778fd7d13d10fd17fdd983e26229b4c41c2f8', 'id': '7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'created_at': datetime.datetime(2026, 11, 5, 17, 48, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f88c667-f6db-4190-9ffe-3f47a47c3d7f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf47fe000>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f351466b-63b0-4153-a739-b3a241238ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f351466b-63b0-4153-a739-b3a241238ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2066a21-4cb6-41c3-b8df-857fe36075fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:06 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Volume 006c2706-ba98-4294-8e3d-491093276197: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-006c2706-ba98-4294-8e3d-491093276197', 'volume_size': 1, 'image_id': '7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bd33764845476c0a11e05559f6fcec63', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '978c1db92aa544f6976b4e554b498d76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd0dfa8c5e441576fdf4fcc65f12ecdcf6bc9b650aac9b567dea01c468faf35b093ec273acee549ae02a0f7e1e7778fd7d13d10fd17fdd983e26229b4c41c2f8', 'id': '7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'created_at': datetime.datetime(2026, 11, 5, 17, 48, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f88c667-f6db-4190-9ffe-3f47a47c3d7f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf47fe000>}
Nov 05 18:48:06 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Trying to clone 006c2706-ba98-4294-8e3d-491093276197 from image 7f88c667-f6db-4190-9ffe-3f47a47c3d7f at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'metadata': {}}]). {{(pid=87086) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 18:48:06 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 18:48:06 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 18:48:06 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7204a98-9ff1-4489-8ba6-c61696bc8f94]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:06 devstack sudo[104019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD
Nov 05 18:48:06 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:07 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:07 devstack sudo[104069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD
Nov 05 18:48:07 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:07 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD" returned: 1 in 0.423s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:48:07 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Temporary image 7f88c667-f6db-4190-9ffe-3f47a47c3d7f is fetched for user 6f7d998472d041a1a89da1e1b99e02ea. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 18:48:07 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48c76fc-968b-48cc-b207-61732a42510b]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:07 devstack sudo[104082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD
Nov 05 18:48:07 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:07 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:08 devstack sudo[104087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD
Nov 05 18:48:08 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:08 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006c2706-ba98-4294-8e3d-491093276197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978c1db92aa544f6976b4e554b498d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:06Z,use_quota=True,user_id='6f7d998472d041a1a89da1e1b99e02ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9eceb49d-80cd-4f2f-bff4-a3fc9e66b4cc),volume_type_id=9eceb49d-80cd-4f2f-bff4-a3fc9e66b4cc)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Creating volume 006c2706-ba98-4294-8e3d-491093276197 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:08 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:08 devstack sudo[104093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 1073741824
Nov 05 18:48:08 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:08 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 1073741824" returned: 0 in 0.414s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:08 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197
Nov 05 18:48:08 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:09 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197" returned: 0 in 0.236s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Attempting download of 7f88c667-f6db-4190-9ffe-3f47a47c3d7f ((None, [{'url': 'file:///opt/stack/data/glance/images/7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'metadata': {}}])) to volume 006c2706-ba98-4294-8e3d-491093276197. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bde972-3d45-48e2-b706-790543ca6c4a]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_b2vya4zw {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:09 devstack sudo[104101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_b2vya4zw
Nov 05 18:48:09 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:09 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_b2vya4zw" returned: 0 in 0.344s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_b2vya4zw {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:09 devstack sudo[104105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_b2vya4zw
Nov 05 18:48:09 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:09 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_b2vya4zw" returned: 1 in 0.312s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_b2vya4zw' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[915b78fa-d8e9-48fc-addb-24e286759668]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:09 devstack sudo[104109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD
Nov 05 18:48:09 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:10 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:10 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD
Nov 05 18:48:10 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:10 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:48:10 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] 7f88c667-f6db-4190-9ffe-3f47a47c3d7f was raw, converting to qcow2 {{(pid=87086) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 18:48:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:10 devstack sudo[104118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197
Nov 05 18:48:10 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:10 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197" returned: 0 in 0.453s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:10 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f88c667-f6db-4190-9ffe-3f47a47c3d7f_f5u84rdzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:48:10 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 18:48:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:10 devstack sudo[104124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 1G
Nov 05 18:48:10 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:11 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 1G" returned: 0 in 0.320s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:11 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Downloaded image 7f88c667-f6db-4190-9ffe-3f47a47c3d7f ((None, [{'url': 'file:///opt/stack/data/glance/images/7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'metadata': {}}])) to volume 006c2706-ba98-4294-8e3d-491093276197 successfully. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 18:48:11 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Temporary image 7f88c667-f6db-4190-9ffe-3f47a47c3d7f for user 6f7d998472d041a1a89da1e1b99e02ea is deleted. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 18:48:11 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Marking volume 006c2706-ba98-4294-8e3d-491093276197 as bootable. {{(pid=87086) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 18:48:11 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Copying metadata from image 7f88c667-f6db-4190-9ffe-3f47a47c3d7f to 006c2706-ba98-4294-8e3d-491093276197. {{(pid=87086) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 18:48:11 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Creating volume glance metadata for volume 006c2706-ba98-4294-8e3d-491093276197 backed by image 7f88c667-f6db-4190-9ffe-3f47a47c3d7f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bd33764845476c0a11e05559f6fcec63', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87086) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 18:48:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2066a21-4cb6-41c3-b8df-857fe36075fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006c2706-ba98-4294-8e3d-491093276197', 'volume_size': 1, 'image_id': '7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bd33764845476c0a11e05559f6fcec63', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '978c1db92aa544f6976b4e554b498d76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd0dfa8c5e441576fdf4fcc65f12ecdcf6bc9b650aac9b567dea01c468faf35b093ec273acee549ae02a0f7e1e7778fd7d13d10fd17fdd983e26229b4c41c2f8', 'id': '7f88c667-f6db-4190-9ffe-3f47a47c3d7f', 'created_at': datetime.datetime(2026, 11, 5, 17, 48, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 48, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f88c667-f6db-4190-9ffe-3f47a47c3d7f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf47fe000>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a834118f-b771-477e-9154-a6d4895da4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:11 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Volume volume-006c2706-ba98-4294-8e3d-491093276197 (006c2706-ba98-4294-8e3d-491093276197): created successfully
Nov 05 18:48:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a834118f-b771-477e-9154-a6d4895da4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Flow 'volume_create_manager' (5ae6927e-3f08-43e0-b271-305326c8762c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:11 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-87d9a905-8c37-479c-89b0-54acd21552ba tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Created volume successfully.
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Acquiring lock "cinder-006c2706-ba98-4294-8e3d-491093276197-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Lock "cinder-006c2706-ba98-4294-8e3d-491093276197-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Acquiring lock "cinder-quobyte-006c2706-ba98-4294-8e3d-491093276197" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Lock "cinder-quobyte-006c2706-ba98-4294-8e3d-491093276197" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81480e1-3941-406e-85d1-19683018b8f6]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:12 devstack sudo[104131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197
Nov 05 18:48:12 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:12 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197" returned: 0 in 0.379s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:12 devstack sudo[104136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197
Nov 05 18:48:12 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:12 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-006c2706-ba98-4294-8e3d-491093276197" returned: 0 in 0.246s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Lock "cinder-quobyte-006c2706-ba98-4294-8e3d-491093276197" released by "delete_volume" :: held 0.669s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:12 devstack cinder-volume[87086]: WARNING cinder.quota [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:48:12 devstack cinder-volume[87086]: WARNING cinder.quota [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:48:12 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Created reservations ['383217db-e362-41c6-9d69-86b808547d95', '0c31ab48-9cf3-493f-ad84-91a3c9c5dc9c', 'b50f0c66-3108-41f6-a355-04388705e387', '50cb89f4-4720-4960-a9c4-81c6b9b968b1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:13 devstack sudo[104139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:13 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:13 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.270s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:13 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:13 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Deleted volume successfully.
Nov 05 18:48:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-70ded5cc-0105-4e13-a00c-d57eab38ec79 tempest-VolumeAndVolumeTypeFromImageTest-1639461976 None] Lock "cinder-006c2706-ba98-4294-8e3d-491093276197-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Acquiring lock "cinder-67a788bc-16d2-474a-94e0-e01b4d82cc14-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Lock "cinder-67a788bc-16d2-474a-94e0-e01b4d82cc14-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Acquiring lock "cinder-quobyte-67a788bc-16d2-474a-94e0-e01b4d82cc14" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Lock "cinder-quobyte-67a788bc-16d2-474a-94e0-e01b4d82cc14" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:15 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcefa4f8-07a6-4dd1-8e4e-c5dde2b4bd7f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:15 devstack sudo[104149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14
Nov 05 18:48:15 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:15 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14" returned: 0 in 0.450s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:15 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14
Nov 05 18:48:15 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:16 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-67a788bc-16d2-474a-94e0-e01b4d82cc14" returned: 0 in 0.279s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Lock "cinder-quobyte-67a788bc-16d2-474a-94e0-e01b4d82cc14" released by "delete_volume" :: held 0.791s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Created reservations ['e3f8c20e-9be6-4cc1-817f-e6f116f96469', '3c1ee83a-70a0-4df7-8073-889f1a28d824', '0e18890d-e079-47ab-b20b-4dd7b3b2e5b8', '497c31a9-31eb-4a06-826a-90ee80506178'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:16 devstack sudo[104158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:16 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:16 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.254s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:16 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Deleted volume successfully.
Nov 05 18:48:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e45f9f04-b357-4401-8c4a-1e73bdfc3d0e tempest-VolumesNegativeTest-426787934 None] Lock "cinder-67a788bc-16d2-474a-94e0-e01b4d82cc14-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (22ca783b-e375-4833-8ff9-6f113ac6f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7087630-f48f-4108-86d0-a35ee3f4772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7087630-f48f-4108-86d0-a35ee3f4772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-567698549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4778b20-dac2-4799-a813-bf5c98c524fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:18Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736c33d0-f7c1-46c2-85b8-1e25d04eb0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736c33d0-f7c1-46c2-85b8-1e25d04eb0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda8b341-6fa7-48d6-aa03-1df123125dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda8b341-6fa7-48d6-aa03-1df123125dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4778b20-dac2-4799-a813-bf5c98c524fd', 'volume_name': 'volume-d4778b20-dac2-4799-a813-bf5c98c524fd', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3b96bd-3a59-4050-be58-ce4eb9fd5d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3b96bd-3a59-4050-be58-ce4eb9fd5d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d770573e-6f03-4ff7-ba2a-33b41db51995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:18 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume d4778b20-dac2-4799-a813-bf5c98c524fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4778b20-dac2-4799-a813-bf5c98c524fd', 'volume_size': 1}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-567698549',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4778b20-dac2-4799-a813-bf5c98c524fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:18Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Creating volume d4778b20-dac2-4799-a813-bf5c98c524fd {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:18 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:18 devstack sudo[104161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd 1073741824
Nov 05 18:48:18 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:18 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd 1073741824" returned: 0 in 0.471s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:18 devstack sudo[104167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd
Nov 05 18:48:18 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:19 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd" returned: 0 in 0.256s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d770573e-6f03-4ff7-ba2a-33b41db51995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4778b20-dac2-4799-a813-bf5c98c524fd', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2449d555-c82c-4798-8ec6-bd91e4f342ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:19 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume volume-d4778b20-dac2-4799-a813-bf5c98c524fd (d4778b20-dac2-4799-a813-bf5c98c524fd): created successfully
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2449d555-c82c-4798-8ec6-bd91e4f342ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (22ca783b-e375-4833-8ff9-6f113ac6f71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:19 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-93593230-c2ac-4551-b102-d945ab059a95 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created volume successfully.
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Flow 'volume_create_manager' (bdc88096-023c-42db-81ea-734567e22bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8849555a-f600-4aec-af83-0699fdd2f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8849555a-f600-4aec-af83-0699fdd2f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1557753014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcfb93b-e617-4ae7-8ea8-a1b354501ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f5233b34954f4285996f2c06521308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:20Z,use_quota=True,user_id='0f4eb68b75914f09ac355b7d7f852465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5914b20e-fed3-4394-aa78-69cbf9950362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5914b20e-fed3-4394-aa78-69cbf9950362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d40739-e23a-4a52-8314-46b3aec2bf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d40739-e23a-4a52-8314-46b3aec2bf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bcfb93b-e617-4ae7-8ea8-a1b354501ea0', 'volume_name': 'volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76aeb5ed-f965-4577-aaea-b469d610a23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76aeb5ed-f965-4577-aaea-b469d610a23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3182cd01-06a6-46dc-88a1-953f5fe701d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:19 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Volume 8bcfb93b-e617-4ae7-8ea8-a1b354501ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0', 'volume_size': 1}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1557753014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcfb93b-e617-4ae7-8ea8-a1b354501ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f5233b34954f4285996f2c06521308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:20Z,use_quota=True,user_id='0f4eb68b75914f09ac355b7d7f852465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Creating volume 8bcfb93b-e617-4ae7-8ea8-a1b354501ea0 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:19 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:19 devstack sudo[104172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0 1073741824
Nov 05 18:48:19 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Flow 'volume_create_manager' (64e39a23-0940-4b93-971a-1543a657e83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29640da7-d6b1-4de0-9cae-7c6d42b3a508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29640da7-d6b1-4de0-9cae-7c6d42b3a508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1944681133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2a5f15-3205-47a8-9202-2db249ce2fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f5233b34954f4285996f2c06521308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:20Z,use_quota=True,user_id='0f4eb68b75914f09ac355b7d7f852465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50a86de-b7bb-4bf8-b171-2575b43d4260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50a86de-b7bb-4bf8-b171-2575b43d4260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81c7fec-bd13-49a0-9e10-b8bc2c140646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81c7fec-bd13-49a0-9e10-b8bc2c140646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d2a5f15-3205-47a8-9202-2db249ce2fd1', 'volume_name': 'volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a7288b-732e-4968-8141-8a19172a7e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a7288b-732e-4968-8141-8a19172a7e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fc7264-5680-4878-a5c2-9bb0fb68b71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Volume 5d2a5f15-3205-47a8-9202-2db249ce2fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1', 'volume_size': 1}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:20 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0 1073741824" returned: 0 in 0.552s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:20 devstack sudo[104183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0
Nov 05 18:48:20 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Flow 'volume_create_manager' (11bbed00-6774-4cb0-872c-289fde2975d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e29841-438a-4fb8-9d6f-211d9cb8e999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e29841-438a-4fb8-9d6f-211d9cb8e999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462396408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4755c3e4-b886-4a8e-b658-c085d21706fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f5233b34954f4285996f2c06521308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:20Z,use_quota=True,user_id='0f4eb68b75914f09ac355b7d7f852465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d935473-9a45-48d4-9889-77a5778a6c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d935473-9a45-48d4-9889-77a5778a6c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30f31b9-1c44-48b7-8691-3f574656aab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30f31b9-1c44-48b7-8691-3f574656aab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4755c3e4-b886-4a8e-b658-c085d21706fe', 'volume_name': 'volume-4755c3e4-b886-4a8e-b658-c085d21706fe', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45491133-3a2e-43f3-af9b-9b1ab1c88cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45491133-3a2e-43f3-af9b-9b1ab1c88cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9cf019-979b-4145-aecf-1cf1b6e1a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Volume 4755c3e4-b886-4a8e-b658-c085d21706fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4755c3e4-b886-4a8e-b658-c085d21706fe', 'volume_size': 1}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:20 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0" returned: 0 in 0.322s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.552s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1944681133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2a5f15-3205-47a8-9202-2db249ce2fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f5233b34954f4285996f2c06521308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:20Z,use_quota=True,user_id='0f4eb68b75914f09ac355b7d7f852465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Creating volume 5d2a5f15-3205-47a8-9202-2db249ce2fd1 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:20 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:20 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1 1073741824
Nov 05 18:48:20 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3182cd01-06a6-46dc-88a1-953f5fe701d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd16252-77f8-4a70-b335-cbe1814c69a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Volume volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0 (8bcfb93b-e617-4ae7-8ea8-a1b354501ea0): created successfully
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd16252-77f8-4a70-b335-cbe1814c69a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Flow 'volume_create_manager' (bdc88096-023c-42db-81ea-734567e22bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:20 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c23ce38d-ea2c-495f-8d76-639e19d011ec tempest-CreateVolumesFromImageTest-1851565737 None] Created volume successfully.
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Flow 'volume_create_manager' (4537ff77-e194-4dba-b7ca-8efcb28b18cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad779a3-2f41-4cb0-a216-51df188b2ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad779a3-2f41-4cb0-a216-51df188b2ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606721483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337d89ea-8e32-49a7-ab22-9bcee0511dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f5233b34954f4285996f2c06521308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:21Z,use_quota=True,user_id='0f4eb68b75914f09ac355b7d7f852465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d5a08e-d2b1-4c62-a518-c5e1ca235ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d5a08e-d2b1-4c62-a518-c5e1ca235ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1ac17f-4d90-4c22-a54c-b6dfd0da2297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1ac17f-4d90-4c22-a54c-b6dfd0da2297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337d89ea-8e32-49a7-ab22-9bcee0511dbe', 'volume_name': 'volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7799ac78-d9c3-4631-80d3-5c29be0ad44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7799ac78-d9c3-4631-80d3-5c29be0ad44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0341b182-29e4-4c88-bcff-5de14bfc3b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Volume 337d89ea-8e32-49a7-ab22-9bcee0511dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe', 'volume_size': 1}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:21 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1 1073741824" returned: 0 in 0.705s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:21 devstack sudo[104200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1
Nov 05 18:48:21 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-ff726e6b-5f02-4575-a0d0-2f80a4aee924 req-c4d33915-c633-4881-8c78-d42572e08b62 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Flow 'volume_create_manager' (fe1f3c1c-1f5d-43e6-8f5e-817025c34795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3c0393-0a67-46bb-ae88-42758c4068eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3c0393-0a67-46bb-ae88-42758c4068eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1145313845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca5057c-41ff-47ea-90b2-2aa78d9b0c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f5233b34954f4285996f2c06521308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:21Z,use_quota=True,user_id='0f4eb68b75914f09ac355b7d7f852465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f83b46-93db-4591-8cac-18de0017c33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f83b46-93db-4591-8cac-18de0017c33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed177ab-da50-45e4-8549-3d39ebb6d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aed177ab-da50-45e4-8549-3d39ebb6d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca5057c-41ff-47ea-90b2-2aa78d9b0c6a', 'volume_name': 'volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa564da1-422b-40b4-958a-63544258759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa564da1-422b-40b4-958a-63544258759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7cedf6-dd6c-4a5b-81cc-1689e31a63b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Volume aca5057c-41ff-47ea-90b2-2aa78d9b0c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a', 'volume_size': 1}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1" returned: 0 in 0.348s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.184s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1462396408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4755c3e4-b886-4a8e-b658-c085d21706fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f5233b34954f4285996f2c06521308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:20Z,use_quota=True,user_id='0f4eb68b75914f09ac355b7d7f852465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Creating volume 4755c3e4-b886-4a8e-b658-c085d21706fe {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:21 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:21 devstack sudo[104204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe 1073741824
Nov 05 18:48:21 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (a158046c-7938-4ff7-a684-c432b3fab345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adec73e2-f9e7-4a16-a085-c304cc0b57dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fc7264-5680-4878-a5c2-9bb0fb68b71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e1604d-5f01-42bb-aa94-c7d6415bafe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adec73e2-f9e7-4a16-a085-c304cc0b57dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1654596494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79adf83-1225-4872-82f8-e3c141b600bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:22Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023d6bb6-4924-4816-8796-839b57f25a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023d6bb6-4924-4816-8796-839b57f25a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67239d2f-d7f4-471c-acbb-63eb07de9a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67239d2f-d7f4-471c-acbb-63eb07de9a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79adf83-1225-4872-82f8-e3c141b600bb', 'volume_name': 'volume-f79adf83-1225-4872-82f8-e3c141b600bb', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da7fb90-abd9-4880-9282-1384a564351f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da7fb90-abd9-4880-9282-1384a564351f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a638c01b-10a7-448f-97f8-7b94ba0110c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:21 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume f79adf83-1225-4872-82f8-e3c141b600bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79adf83-1225-4872-82f8-e3c141b600bb', 'volume_size': 1}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:21 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Volume volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1 (5d2a5f15-3205-47a8-9202-2db249ce2fd1): created successfully
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e1604d-5f01-42bb-aa94-c7d6415bafe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Flow 'volume_create_manager' (64e39a23-0940-4b93-971a-1543a657e83e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b3dc6c89-b806-4f8f-b7c8-0fbe7066e917 tempest-CreateVolumesFromImageTest-1851565737 None] Created volume successfully.
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (fd427514-116a-4171-bab8-eb03c775e04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce98fd2-90d4-49d2-ba6b-8b794ce36d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ce98fd2-90d4-49d2-ba6b-8b794ce36d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1581693250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c97e879-cd8c-4dd1-be0f-9325ee3a982e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:22Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f245091-efce-4d8e-927f-3758f04374eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f245091-efce-4d8e-927f-3758f04374eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf085c8d-3b2f-424a-8f97-c101011087c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf085c8d-3b2f-424a-8f97-c101011087c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c97e879-cd8c-4dd1-be0f-9325ee3a982e', 'volume_name': 'volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b11a701-5b2d-47c2-b461-be861bdb58c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b11a701-5b2d-47c2-b461-be861bdb58c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e80e355-ce23-4849-b6f2-4472c7799135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume 3c97e879-cd8c-4dd1-be0f-9325ee3a982e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e', 'volume_size': 1}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:22 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe 1073741824" returned: 0 in 0.529s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (93bf07a6-f362-4e9d-81e6-b712781f67f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f0e61d-5f93-4b67-85ca-76b700b5742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f0e61d-5f93-4b67-85ca-76b700b5742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1186100953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e30627-953c-491f-bbf3-c89afa318cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:22Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6d737b-d9df-40b1-87d7-9c03b05c5822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack sudo[104210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe
Nov 05 18:48:22 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee6d737b-d9df-40b1-87d7-9c03b05c5822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175be329-73c4-4b02-b1e4-837c90584bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175be329-73c4-4b02-b1e4-837c90584bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e30627-953c-491f-bbf3-c89afa318cf9', 'volume_name': 'volume-a2e30627-953c-491f-bbf3-c89afa318cf9', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c59b22-4f34-488d-a15f-c487cb57c16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c59b22-4f34-488d-a15f-c487cb57c16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46aadb85-3dd5-48cc-9902-b02d7e3384f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume a2e30627-953c-491f-bbf3-c89afa318cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e30627-953c-491f-bbf3-c89afa318cf9', 'volume_size': 1}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:22 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe" returned: 0 in 0.267s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.757s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-606721483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=337d89ea-8e32-49a7-ab22-9bcee0511dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f5233b34954f4285996f2c06521308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:21Z,use_quota=True,user_id='0f4eb68b75914f09ac355b7d7f852465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Creating volume 337d89ea-8e32-49a7-ab22-9bcee0511dbe {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:22 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:22 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe 1073741824
Nov 05 18:48:22 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9cf019-979b-4145-aecf-1cf1b6e1a280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4755c3e4-b886-4a8e-b658-c085d21706fe', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22d47fc-66ae-4bf9-8ac8-352849016e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (10aff92b-e049-4cbe-bfb9-d3e9985feac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26d0d19-da7c-49cd-a2ee-b9962c5e106b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Volume volume-4755c3e4-b886-4a8e-b658-c085d21706fe (4755c3e4-b886-4a8e-b658-c085d21706fe): created successfully
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22d47fc-66ae-4bf9-8ac8-352849016e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Flow 'volume_create_manager' (11bbed00-6774-4cb0-872c-289fde2975d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26d0d19-da7c-49cd-a2ee-b9962c5e106b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1162181263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd96595-3a56-48a2-9c36-76f35e7df115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:23Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01a7488-f406-45d5-960b-a3e9eacd1f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01a7488-f406-45d5-960b-a3e9eacd1f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414430aa-abc2-4b68-b1ec-ba15f4b563be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414430aa-abc2-4b68-b1ec-ba15f4b563be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd96595-3a56-48a2-9c36-76f35e7df115', 'volume_name': 'volume-7bd96595-3a56-48a2-9c36-76f35e7df115', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad595e7-aa51-48ff-813b-561f7ee5ef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad595e7-aa51-48ff-813b-561f7ee5ef46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8e6de7-d79d-4f7d-8087-5f5915c25557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:22 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume 7bd96595-3a56-48a2-9c36-76f35e7df115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd96595-3a56-48a2-9c36-76f35e7df115', 'volume_size': 1}
Nov 05 18:48:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:22 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-13e2255f-1aba-427c-918d-ca8184a2114a tempest-CreateVolumesFromImageTest-1851565737 None] Created volume successfully.
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (9aecea1f-2935-4fa4-b99c-cc1ea259a13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfbe89a-027b-4295-8bb8-d716171bc9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:23 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfbe89a-027b-4295-8bb8-d716171bc9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-855602028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d083abd-32c1-4240-a662-d90a2869c7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:23Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810c1665-11ee-41a5-b47c-b18585a9c42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (810c1665-11ee-41a5-b47c-b18585a9c42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1a461f-9821-4e43-8e2d-9c0833e7572b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1a461f-9821-4e43-8e2d-9c0833e7572b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d083abd-32c1-4240-a662-d90a2869c7fb', 'volume_name': 'volume-5d083abd-32c1-4240-a662-d90a2869c7fb', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992c7df1-c21e-45b3-ab38-2ac9c9e9e145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992c7df1-c21e-45b3-ab38-2ac9c9e9e145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0999df8-35af-419e-b14d-e6a6036b6300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume 5d083abd-32c1-4240-a662-d90a2869c7fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d083abd-32c1-4240-a662-d90a2869c7fb', 'volume_size': 1}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe 1073741824" returned: 0 in 0.592s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:23 devstack sudo[104219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe
Nov 05 18:48:23 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:23 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe" returned: 0 in 0.234s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-ff726e6b-5f02-4575-a0d0-2f80a4aee924 req-c4d33915-c633-4881-8c78-d42572e08b62 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.034s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-ff726e6b-5f02-4575-a0d0-2f80a4aee924 req-c4d33915-c633-4881-8c78-d42572e08b62 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.922s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1145313845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca5057c-41ff-47ea-90b2-2aa78d9b0c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3f5233b34954f4285996f2c06521308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:21Z,use_quota=True,user_id='0f4eb68b75914f09ac355b7d7f852465',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Creating volume aca5057c-41ff-47ea-90b2-2aa78d9b0c6a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:23 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0341b182-29e4-4c88-bcff-5de14bfc3b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52e925c-0aee-4b28-a2d3-22f641efa433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:23 devstack sudo[104222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a 1073741824
Nov 05 18:48:23 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Volume volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe (337d89ea-8e32-49a7-ab22-9bcee0511dbe): created successfully
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52e925c-0aee-4b28-a2d3-22f641efa433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Flow 'volume_create_manager' (4537ff77-e194-4dba-b7ca-8efcb28b18cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-ff726e6b-5f02-4575-a0d0-2f80a4aee924 req-c4d33915-c633-4881-8c78-d42572e08b62 tempest-TestInstancesWithCinderVolumes-1445035719 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04e27cad-b832-4511-bf2b-01c2183143f0', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:48:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f0782ed7-5f16-4dd5-9091-8bc89eabd847 tempest-CreateVolumesFromImageTest-1851565737 None] Created volume successfully.
Nov 05 18:48:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-ff726e6b-5f02-4575-a0d0-2f80a4aee924 req-c4d33915-c633-4881-8c78-d42572e08b62 tempest-TestInstancesWithCinderVolumes-1445035719 None] attachment_update completed successfully.
Nov 05 18:48:24 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a 1073741824" returned: 0 in 0.501s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:24 devstack sudo[104230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a
Nov 05 18:48:24 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:24 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a" returned: 0 in 0.262s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1654596494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79adf83-1225-4872-82f8-e3c141b600bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:22Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Creating volume f79adf83-1225-4872-82f8-e3c141b600bb {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:24 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7cedf6-dd6c-4a5b-81cc-1689e31a63b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:24 devstack sudo[104233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb 1073741824
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc34eab2-ee98-4b6e-a72e-246c029b53ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:24 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:24 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Volume volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a (aca5057c-41ff-47ea-90b2-2aa78d9b0c6a): created successfully
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc34eab2-ee98-4b6e-a72e-246c029b53ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Flow 'volume_create_manager' (fe1f3c1c-1f5d-43e6-8f5e-817025c34795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-eb32aa00-b776-46b2-ba27-775ea2ef0c5f tempest-CreateVolumesFromImageTest-1851565737 None] Created volume successfully.
Nov 05 18:48:24 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb 1073741824" returned: 0 in 0.446s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:24 devstack sudo[104243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb
Nov 05 18:48:24 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:25 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb" returned: 0 in 0.242s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.144s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1581693250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c97e879-cd8c-4dd1-be0f-9325ee3a982e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:22Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Creating volume 3c97e879-cd8c-4dd1-be0f-9325ee3a982e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:25 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a638c01b-10a7-448f-97f8-7b94ba0110c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79adf83-1225-4872-82f8-e3c141b600bb', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acc7a9e-d93a-4200-82ed-57c9f8a8bb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:25 devstack sudo[104248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e 1073741824
Nov 05 18:48:25 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:25 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume volume-f79adf83-1225-4872-82f8-e3c141b600bb (f79adf83-1225-4872-82f8-e3c141b600bb): created successfully
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acc7a9e-d93a-4200-82ed-57c9f8a8bb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (a158046c-7938-4ff7-a684-c432b3fab345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "cinder-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:25 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fa785cd7-8d40-44cb-98db-18b99e32d7e6 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created volume successfully.
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "cinder-quobyte-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:25 devstack sudo[104257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:25 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-quobyte-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[2875a6c9-cd6e-4d61-9e4e-20a5afe5bda9]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:25 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e 1073741824" returned: 0 in 0.634s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:25 devstack sudo[104259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a
Nov 05 18:48:25 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:25 devstack sudo[104266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e
Nov 05 18:48:25 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:25 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.349s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:48:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-6c6a49e8-60fd-4d8a-9f57-3112bc62cbe8 req-487f8e7f-2858-4abc-860d-644261d4373d tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:26 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a" returned: 0 in 0.455s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:26 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e" returned: 0 in 0.276s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:26 devstack sudo[104276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a
Nov 05 18:48:26 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.631s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1186100953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e30627-953c-491f-bbf3-c89afa318cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:22Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Creating volume a2e30627-953c-491f-bbf3-c89afa318cf9 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:26 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e80e355-ce23-4849-b6f2-4472c7799135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:26 devstack sudo[104278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9 1073741824
Nov 05 18:48:26 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cc5b12-5d21-4507-82b5-792ba5de850d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:26 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e (3c97e879-cd8c-4dd1-be0f-9325ee3a982e): created successfully
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cc5b12-5d21-4507-82b5-792ba5de850d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (fd427514-116a-4171-bab8-eb03c775e04d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1bdda0c8-7e31-4e62-8e27-3906501995c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created volume successfully.
Nov 05 18:48:26 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a" returned: 0 in 0.254s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-quobyte-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a" released by "delete_volume" :: held 0.761s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Created reservations ['f32264c1-77bf-4153-a107-2149de0b8df6', '6de4ecc2-02ba-4190-bafd-8f363ab4ee4c', '937fc4ea-5957-486a-8d78-96cb575d0809', '94d1c654-0d9f-4a61-822a-97efff15f4b9'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:26 devstack sudo[104284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:26 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:26 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9 1073741824" returned: 0 in 0.483s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:26 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.249s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Deleted volume successfully.
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-310fb425-1290-4830-9343-2198d26c6085 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-aca5057c-41ff-47ea-90b2-2aa78d9b0c6a-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:26 devstack sudo[104288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "cinder-337d89ea-8e32-49a7-ab22-9bcee0511dbe-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:26 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-337d89ea-8e32-49a7-ab22-9bcee0511dbe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "cinder-quobyte-337d89ea-8e32-49a7-ab22-9bcee0511dbe" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-quobyte-337d89ea-8e32-49a7-ab22-9bcee0511dbe" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[26895e95-11ef-4b1c-8d88-b5a6831962ae]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:27 devstack sudo[104290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe
Nov 05 18:48:27 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:27 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9" returned: 0 in 0.267s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.205s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1162181263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd96595-3a56-48a2-9c36-76f35e7df115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:23Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Creating volume 7bd96595-3a56-48a2-9c36-76f35e7df115 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:27 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46aadb85-3dd5-48cc-9902-b02d7e3384f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e30627-953c-491f-bbf3-c89afa318cf9', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:27 devstack sudo[104293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115 1073741824
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3c97e0-efd2-408a-949a-52ebad51ade3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:27 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:27 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume volume-a2e30627-953c-491f-bbf3-c89afa318cf9 (a2e30627-953c-491f-bbf3-c89afa318cf9): created successfully
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3c97e0-efd2-408a-949a-52ebad51ade3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (93bf07a6-f362-4e9d-81e6-b712781f67f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:27 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e900b1ce-83d0-43ea-b9a0-62dc56330a30 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created volume successfully.
Nov 05 18:48:27 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe" returned: 0 in 0.385s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:27 devstack sudo[104301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe
Nov 05 18:48:27 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:27 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115 1073741824" returned: 0 in 0.449s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:27 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-337d89ea-8e32-49a7-ab22-9bcee0511dbe" returned: 0 in 0.264s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:27 devstack sudo[104305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115
Nov 05 18:48:27 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-quobyte-337d89ea-8e32-49a7-ab22-9bcee0511dbe" released by "delete_volume" :: held 0.707s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Created reservations ['14a48617-7660-4ec0-a1da-ab6db87a9014', '1e7fea97-82ef-40be-8174-99bbed30b2c0', '99004d0b-4ac4-446d-8a5d-ba7ecd17455c', '8d2fec0e-5bd3-4cbd-8ed2-9579f1a27340'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:27 devstack sudo[104307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:27 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:27 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115" returned: 0 in 0.245s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.539s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-855602028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d083abd-32c1-4240-a662-d90a2869c7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dda50546ddcf422fa14d949d5aac5580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:23Z,use_quota=True,user_id='d0654fde3a2f415cb903461100f302db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Creating volume 5d083abd-32c1-4240-a662-d90a2869c7fb {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:27 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8e6de7-d79d-4f7d-8087-5f5915c25557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd96595-3a56-48a2-9c36-76f35e7df115', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:27 devstack sudo[104310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb 1073741824
Nov 05 18:48:27 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432ee8de-7a71-4bb2-bb49-979c6fc64e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:27 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume volume-7bd96595-3a56-48a2-9c36-76f35e7df115 (7bd96595-3a56-48a2-9c36-76f35e7df115): created successfully
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432ee8de-7a71-4bb2-bb49-979c6fc64e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (10aff92b-e049-4cbe-bfb9-d3e9985feac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:27 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c8fecbc3-a985-4e50-b0a9-f4fb8e8d58dd tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created volume successfully.
Nov 05 18:48:28 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.279s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:28 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Deleted volume successfully.
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ef9ee4d0-69ad-4c38-8b41-180d9cf060e0 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-337d89ea-8e32-49a7-ab22-9bcee0511dbe-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "cinder-4755c3e4-b886-4a8e-b658-c085d21706fe-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-4755c3e4-b886-4a8e-b658-c085d21706fe-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "cinder-quobyte-4755c3e4-b886-4a8e-b658-c085d21706fe" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-quobyte-4755c3e4-b886-4a8e-b658-c085d21706fe" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9a4322-98cb-4e21-8339-ce1329a5c5f9]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:28 devstack sudo[104316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe
Nov 05 18:48:28 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:28 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb 1073741824" returned: 0 in 0.461s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:28 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb
Nov 05 18:48:28 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:28 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe" returned: 0 in 0.369s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:28 devstack sudo[104325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe
Nov 05 18:48:28 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:28 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb" returned: 0 in 0.243s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-6c6a49e8-60fd-4d8a-9f57-3112bc62cbe8 req-487f8e7f-2858-4abc-860d-644261d4373d tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.589s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-6c6a49e8-60fd-4d8a-9f57-3112bc62cbe8 req-487f8e7f-2858-4abc-860d-644261d4373d tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0999df8-35af-419e-b14d-e6a6036b6300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d083abd-32c1-4240-a662-d90a2869c7fb', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2512d95-2b64-431a-9f2d-69cbe72013ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:28 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Volume volume-5d083abd-32c1-4240-a662-d90a2869c7fb (5d083abd-32c1-4240-a662-d90a2869c7fb): created successfully
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2512d95-2b64-431a-9f2d-69cbe72013ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Flow 'volume_create_manager' (9aecea1f-2935-4fa4-b99c-cc1ea259a13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:28 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0aaad920-fefd-44e6-857e-bf104109039f tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created volume successfully.
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-6c6a49e8-60fd-4d8a-9f57-3112bc62cbe8 req-487f8e7f-2858-4abc-860d-644261d4373d tempest-TestInstancesWithCinderVolumes-1445035719 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-e5add442-90b7-493b-bbec-6952955dccf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb662793-90a9-4955-9917-206a1ca80d5a', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:48:28 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-6c6a49e8-60fd-4d8a-9f57-3112bc62cbe8 req-487f8e7f-2858-4abc-860d-644261d4373d tempest-TestInstancesWithCinderVolumes-1445035719 None] attachment_update completed successfully.
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-5d083abd-32c1-4240-a662-d90a2869c7fb-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-5d083abd-32c1-4240-a662-d90a2869c7fb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:28 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4755c3e4-b886-4a8e-b658-c085d21706fe" returned: 0 in 0.313s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-quobyte-5d083abd-32c1-4240-a662-d90a2869c7fb" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-quobyte-4755c3e4-b886-4a8e-b658-c085d21706fe" released by "delete_volume" :: held 0.734s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-5d083abd-32c1-4240-a662-d90a2869c7fb" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e028d2b4-ef3a-4bbf-9325-9cc109b3a229]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Created reservations ['f8f9d168-ea11-44fa-8e43-e5c79622b52e', '94f9ab54-f276-4f5f-b2b7-f63250ccffbb', 'b17cb48a-2d37-450b-98a7-3883855b6d84', '4b90d726-7790-4d9e-a01f-fd764429724a'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:29 devstack sudo[104330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb
Nov 05 18:48:29 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:29 devstack sudo[104332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:29 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "cinder-5d2a5f15-3205-47a8-9202-2db249ce2fd1-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-5d2a5f15-3205-47a8-9202-2db249ce2fd1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "cinder-quobyte-5d2a5f15-3205-47a8-9202-2db249ce2fd1" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-quobyte-5d2a5f15-3205-47a8-9202-2db249ce2fd1" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:29 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Deleted volume successfully.
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[979a40ac-b61c-4337-a2dc-0bb7b8f6a8f3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:29 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb" returned: 0 in 0.540s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-55287630-887e-489b-b4f2-17dcbd5a314f tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-4755c3e4-b886-4a8e-b658-c085d21706fe-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:29 devstack sudo[104340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb
Nov 05 18:48:29 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:29 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1
Nov 05 18:48:29 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:29 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d083abd-32c1-4240-a662-d90a2869c7fb" returned: 0 in 0.290s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-5d083abd-32c1-4240-a662-d90a2869c7fb" released by "delete_volume" :: held 0.869s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created reservations ['f75083d5-7322-400c-88b8-b6f374cb24b9', '8729b00e-804e-4f59-bf6c-3a7b1bfb0b3c', '7bc5a164-25ea-4f61-b744-20655118b92a', '221ec695-d34b-4c33-9ee5-9e544997e19d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:29 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1" returned: 0 in 0.391s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:29 devstack sudo[104347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1
Nov 05 18:48:29 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:29 devstack sudo[104349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:29 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-7bd96595-3a56-48a2-9c36-76f35e7df115-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-7bd96595-3a56-48a2-9c36-76f35e7df115-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-quobyte-7bd96595-3a56-48a2-9c36-76f35e7df115" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-7bd96595-3a56-48a2-9c36-76f35e7df115" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b938f7-0185-4816-acaa-25e634d0932e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:30 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5d2a5f15-3205-47a8-9202-2db249ce2fd1" returned: 0 in 0.341s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:30 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-quobyte-5d2a5f15-3205-47a8-9202-2db249ce2fd1" released by "delete_volume" :: held 0.797s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:30 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Deleted volume successfully.
Nov 05 18:48:30 devstack sudo[104351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115
Nov 05 18:48:30 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7822acaa-3d43-47e0-ba14-ac317403887d tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-5d083abd-32c1-4240-a662-d90a2869c7fb-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Created reservations ['fabee363-7082-405a-9732-ececfad93055', '385c2332-adf5-4a31-8f9f-c256624f4b56', '7a2fc4fa-eec6-4307-a1b0-a4faa4762270', 'c094ee7a-271d-486e-a657-658d0beaabda'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:30 devstack sudo[104357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:30 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "cinder-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:30 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115" returned: 0 in 0.455s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:30 devstack sudo[104368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115
Nov 05 18:48:30 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "cinder-quobyte-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-quobyte-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9d3f6e-189f-4b5b-819d-468d83251d9b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:30 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.318s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:30 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Deleted volume successfully.
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f566be54-1322-4e1e-a519-29fa59beb5ec tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-5d2a5f15-3205-47a8-9202-2db249ce2fd1-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:30 devstack sudo[104371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0
Nov 05 18:48:30 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:30 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7bd96595-3a56-48a2-9c36-76f35e7df115" returned: 0 in 0.301s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-7bd96595-3a56-48a2-9c36-76f35e7df115" released by "delete_volume" :: held 0.814s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:30 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created reservations ['a49b34ff-33cb-430f-b964-c65b553e0d8e', '5181c983-3f85-44c8-9e9c-6f933aaaa420', 'a4b27ee5-3794-4b56-9617-13e305dcf56a', '464696b4-d63b-4c12-9989-37fd3b7bfbf4'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:31 devstack sudo[104376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:31 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:31 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0" returned: 0 in 0.408s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:31 devstack sudo[104379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0
Nov 05 18:48:31 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-a2e30627-953c-491f-bbf3-c89afa318cf9-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-a2e30627-953c-491f-bbf3-c89afa318cf9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-quobyte-a2e30627-953c-491f-bbf3-c89afa318cf9" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-a2e30627-953c-491f-bbf3-c89afa318cf9" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:31 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.322s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f3842a-73a8-4871-bb0d-9e95eedf6632]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:31 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Deleted volume successfully.
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:31 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f09264cd-ac42-4568-9c7b-d6ce1e215356 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-7bd96595-3a56-48a2-9c36-76f35e7df115-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0" returned: 0 in 0.297s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-quobyte-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0" released by "delete_volume" :: held 0.755s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Created reservations ['b4f54e44-f7ef-4053-b95d-f437cae377df', '6c564662-c6e0-4491-92bc-25f3360944af', '48af44dd-eaf5-4dc5-85b0-96e45613c18c', 'aee55cdb-6d96-4f4d-9005-f3141438767a'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:31 devstack sudo[104383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9
Nov 05 18:48:31 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:31 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:31 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:31 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9" returned: 0 in 0.416s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:31 devstack sudo[104390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9
Nov 05 18:48:31 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:31 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.321s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:31 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Deleted volume successfully.
Nov 05 18:48:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-680b7e49-a483-4ac2-9667-2902197b0547 tempest-CreateVolumesFromImageTest-1851565737 None] Lock "cinder-8bcfb93b-e617-4ae7-8ea8-a1b354501ea0-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:32 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-a2e30627-953c-491f-bbf3-c89afa318cf9" returned: 0 in 0.279s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-a2e30627-953c-491f-bbf3-c89afa318cf9" released by "delete_volume" :: held 0.745s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created reservations ['a1f90396-7e2e-4957-a5e4-17ad14bd8a8f', '52585178-3770-45f0-853a-a28ffc9a68da', 'adf3621b-071a-46bd-9352-74b935099db5', 'bb891393-9a70-449e-a844-9315c903f553'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:32 devstack sudo[104394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:32 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-3c97e879-cd8c-4dd1-be0f-9325ee3a982e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-3c97e879-cd8c-4dd1-be0f-9325ee3a982e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-quobyte-3c97e879-cd8c-4dd1-be0f-9325ee3a982e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-3c97e879-cd8c-4dd1-be0f-9325ee3a982e" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:32 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.305s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Deleted volume successfully.
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c1bea1-28dd-4c91-b494-2cc56a6a3878]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e35b21d7-106d-400e-b512-c7cb4465d32a tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-a2e30627-953c-491f-bbf3-c89afa318cf9-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:32 devstack sudo[104397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e
Nov 05 18:48:32 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:32 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e" returned: 0 in 0.437s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:33 devstack sudo[104407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e
Nov 05 18:48:33 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:33 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3c97e879-cd8c-4dd1-be0f-9325ee3a982e" returned: 0 in 0.281s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-3c97e879-cd8c-4dd1-be0f-9325ee3a982e" released by "delete_volume" :: held 0.773s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created reservations ['0276409a-f196-4356-9c8a-abc87d90e9eb', '1a1d9e1f-bdab-4b3b-b9a0-255b9d046872', '8ebf6504-f47e-42ef-b1a5-c8fba1c3b65f', 'b2c07491-74ed-4346-a02c-9c6af52ac7d2'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:33 devstack sudo[104418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:33 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-f79adf83-1225-4872-82f8-e3c141b600bb-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-f79adf83-1225-4872-82f8-e3c141b600bb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-quobyte-f79adf83-1225-4872-82f8-e3c141b600bb" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-f79adf83-1225-4872-82f8-e3c141b600bb" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d43a1c3-1c98-460f-944b-f0435e2a7814]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:33 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.337s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Deleted volume successfully.
Nov 05 18:48:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b9dfeafc-ac29-4bc6-8db2-126a5b2c7e89 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-3c97e879-cd8c-4dd1-be0f-9325ee3a982e-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:33 devstack sudo[104429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb
Nov 05 18:48:33 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:34 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb" returned: 0 in 0.416s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:34 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb
Nov 05 18:48:34 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:34 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f79adf83-1225-4872-82f8-e3c141b600bb" returned: 0 in 0.313s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-f79adf83-1225-4872-82f8-e3c141b600bb" released by "delete_volume" :: held 0.780s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created reservations ['fcc3f0ff-224d-4200-beca-c70e23defee2', '3b2d9489-aa68-4ff4-8d3b-a4f67249d68b', '9da4fed3-729a-43db-940b-fa7c4cbcdf23', 'f92693f7-d40a-44f1-a9b8-4bed011feca3'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:34 devstack sudo[104442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:34 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:34 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-961472b9-5aec-4661-9f63-ef543a745a41 req-230da1bc-ee51-438d-998c-eefaffcac774 tempest-TestInstancesWithCinderVolumes-1445035719 None] Terminate volume connection completed successfully.
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-961472b9-5aec-4661-9f63-ef543a745a41 req-230da1bc-ee51-438d-998c-eefaffcac774 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deleting attachment 04e27cad-b832-4511-bf2b-01c2183143f0. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-d4778b20-dac2-4799-a813-bf5c98c524fd-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:34 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-d4778b20-dac2-4799-a813-bf5c98c524fd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:34 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Deleted volume successfully.
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7ba6c4f-615c-4047-a95e-0fc8fc0a59c1 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-f79adf83-1225-4872-82f8-e3c141b600bb-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "cinder-quobyte-d4778b20-dac2-4799-a813-bf5c98c524fd" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-d4778b20-dac2-4799-a813-bf5c98c524fd" acquired by "delete_volume" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[42868a70-69b2-4b9c-bd53-9122a1dc1295]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:35 devstack sudo[104445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd
Nov 05 18:48:35 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (dd96662b-0f01-4e45-aa10-0deebf77ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01801969-384a-45c5-bcd2-9c0e26f30f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01801969-384a-45c5-bcd2-9c0e26f30f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022488982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedfb32a-5e15-4dca-b5c6-4238751014ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:35Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115558e0-4e34-4b6e-b1ae-4771ae5c777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115558e0-4e34-4b6e-b1ae-4771ae5c777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5486b7d-e6ad-4b68-b05a-6bfc57548867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5486b7d-e6ad-4b68-b05a-6bfc57548867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eedfb32a-5e15-4dca-b5c6-4238751014ec', 'volume_name': 'volume-eedfb32a-5e15-4dca-b5c6-4238751014ec', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fcd0f8-9128-452e-a5ca-f83c2d94833f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fcd0f8-9128-452e-a5ca-f83c2d94833f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7253610b-c9f2-4159-9b34-fe70cf985f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:35 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume eedfb32a-5e15-4dca-b5c6-4238751014ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eedfb32a-5e15-4dca-b5c6-4238751014ec', 'volume_size': 1}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022488982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedfb32a-5e15-4dca-b5c6-4238751014ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:35Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Creating volume eedfb32a-5e15-4dca-b5c6-4238751014ec {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:35 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:35 devstack sudo[104451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec 1073741824
Nov 05 18:48:35 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:35 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd" returned: 0 in 0.381s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:35 devstack sudo[104453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd
Nov 05 18:48:35 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "cinder-3f2afa3c-993b-43e6-8397-125b8ab7c7de-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-3f2afa3c-993b-43e6-8397-125b8ab7c7de-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "cinder-quobyte-3f2afa3c-993b-43e6-8397-125b8ab7c7de" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-quobyte-3f2afa3c-993b-43e6-8397-125b8ab7c7de" acquired by "delete_volume" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[85619aef-0748-4c3e-b5a2-5c597f7b413a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:35 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d4778b20-dac2-4799-a813-bf5c98c524fd" returned: 0 in 0.292s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-quobyte-d4778b20-dac2-4799-a813-bf5c98c524fd" released by "delete_volume" :: held 0.721s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:35 devstack sudo[104461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de
Nov 05 18:48:35 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Created reservations ['78700e06-59bb-440e-a31d-0fd7b9ace62e', 'b2bd077a-0fc8-4b9e-8823-e51b39e0ef14', 'ba51cb73-a4a9-4f05-be93-59cfea646a11', '9d15636c-3a5c-4761-93e7-833f954ee7a1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:35 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:35 devstack sudo[104467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec 1073741824" returned: 0 in 0.524s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:35 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:35 devstack sudo[104469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec
Nov 05 18:48:35 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:36 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de" returned: 0 in 0.501s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:36 devstack sudo[104474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de
Nov 05 18:48:36 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:36 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.318s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Deleted volume successfully.
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3a19d7f8-0f57-4994-ad89-60ba2ac933c2 tempest-CreateVolumesFromSourceVolumeTest-752095471 None] Lock "cinder-d4778b20-dac2-4799-a813-bf5c98c524fd-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:36 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec" returned: 0 in 0.342s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7253610b-c9f2-4159-9b34-fe70cf985f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eedfb32a-5e15-4dca-b5c6-4238751014ec', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a44105-e448-41fd-935f-dac84a8c8c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:36 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume volume-eedfb32a-5e15-4dca-b5c6-4238751014ec (eedfb32a-5e15-4dca-b5c6-4238751014ec): created successfully
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a44105-e448-41fd-935f-dac84a8c8c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (dd96662b-0f01-4e45-aa10-0deebf77ae21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-573d29a6-bef4-4de0-b3fe-0109e68c6528 tempest-CreateVolumesFromSnapshotTest-690064554 None] Created volume successfully.
Nov 05 18:48:36 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3f2afa3c-993b-43e6-8397-125b8ab7c7de" returned: 0 in 0.371s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-quobyte-3f2afa3c-993b-43e6-8397-125b8ab7c7de" released by "delete_volume" :: held 0.920s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:36 devstack cinder-volume[87086]: WARNING cinder.quota [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-193859324-2054967789 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-193859324-2054967789, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:48:36 devstack cinder-volume[87086]: WARNING cinder.quota [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-193859324-2054967789 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-193859324-2054967789, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Created reservations ['44d02e23-07c0-4b11-97e2-d2da7ef7f74d', '50c990cd-ac24-4292-8d26-03d9a4035946', 'b1c6ea62-162d-4542-8986-19e20d9a704f', 'c263b9b7-3584-4b1a-a237-752f47af0610'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:36 devstack sudo[104479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:36 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:36 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.275s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deleted volume successfully.
Nov 05 18:48:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-88629738-1200-4e1e-b265-e5d61c42ef05 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-3f2afa3c-993b-43e6-8397-125b8ab7c7de-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Creating offline snapshot 2282e361-7da3-4488-938d-4b33e85e422f of volume eedfb32a-5e15-4dca-b5c6-4238751014ec {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:48:38 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f3d3c2-b82e-4782-8742-6cdf7c824a82]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:38 devstack sudo[104488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec
Nov 05 18:48:38 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:38 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec" returned: 0 in 0.435s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:38 devstack sudo[104500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f 1G
Nov 05 18:48:38 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:38 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f 1G" returned: 0 in 0.435s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eedfb32a-5e15-4dca-b5c6-4238751014ec -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:38 devstack sudo[104514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eedfb32a-5e15-4dca-b5c6-4238751014ec -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f
Nov 05 18:48:38 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:39 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eedfb32a-5e15-4dca-b5c6-4238751014ec -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f" returned: 0 in 0.332s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:39 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f is being set with open permissions: ugo+rw
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:39 devstack sudo[104522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f
Nov 05 18:48:39 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:39 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f" returned: 0 in 0.302s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:39 devstack sudo[104525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.info
Nov 05 18:48:39 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-563a0cb7-5170-4ae3-989c-f533bf8208b6 req-b12a196b-902d-41fd-87ab-84534369f2eb tempest-TestInstancesWithCinderVolumes-1445035719 None] Terminate volume connection completed successfully.
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-563a0cb7-5170-4ae3-989c-f533bf8208b6 req-b12a196b-902d-41fd-87ab-84534369f2eb tempest-TestInstancesWithCinderVolumes-1445035719 None] Deleting attachment fb662793-90a9-4955-9917-206a1ca80d5a. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Flow 'volume_create_manager' (c0a4ade9-c866-4507-a103-340492dcda61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e89949-3699-48f3-9802-42ca1a86c14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e89949-3699-48f3-9802-42ca1a86c14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83555504-d4ce-4ca5-a153-e31136489839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f154cbf334544b9c8591acfffe011b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:40Z,use_quota=True,user_id='392c91899cc147d5b7e33b66e9f252bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b066003-940a-4903-a438-be88dec1d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:39 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b066003-940a-4903-a438-be88dec1d21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fffd55-5935-4a12-b6fc-888e816fa0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fffd55-5935-4a12-b6fc-888e816fa0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83555504-d4ce-4ca5-a153-e31136489839', 'volume_name': 'volume-83555504-d4ce-4ca5-a153-e31136489839', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91b44f9-1631-48af-86f9-f3f113663c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91b44f9-1631-48af-86f9-f3f113663c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561516af-a2e3-491f-904b-212fc17853ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:39 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Volume 83555504-d4ce-4ca5-a153-e31136489839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83555504-d4ce-4ca5-a153-e31136489839', 'volume_size': 1}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.info" returned: 0 in 0.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:39 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.info is being set with open permissions: ugo+rw
Nov 05 18:48:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:39 devstack sudo[104530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.info
Nov 05 18:48:39 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:40 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.info" returned: 0 in 0.239s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.263s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83555504-d4ce-4ca5-a153-e31136489839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f154cbf334544b9c8591acfffe011b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:40Z,use_quota=True,user_id='392c91899cc147d5b7e33b66e9f252bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Creating volume 83555504-d4ce-4ca5-a153-e31136489839 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:40 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:40 devstack sudo[104533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839 1073741824
Nov 05 18:48:40 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:40 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-079333fd-06ec-4cd8-98c4-8e8bba2fc87b tempest-CreateVolumesFromSnapshotTest-690064554 None] Create snapshot completed successfully
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "cinder-e5add442-90b7-493b-bbec-6952955dccf9-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-e5add442-90b7-493b-bbec-6952955dccf9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "cinder-quobyte-e5add442-90b7-493b-bbec-6952955dccf9" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:40 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-quobyte-e5add442-90b7-493b-bbec-6952955dccf9" acquired by "delete_volume" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839 1073741824" returned: 0 in 0.466s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7759fc-f463-4585-a956-151111fbce87]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:40 devstack sudo[104540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839
Nov 05 18:48:40 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:40 devstack sudo[104539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9
Nov 05 18:48:40 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:40 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839" returned: 0 in 0.275s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561516af-a2e3-491f-904b-212fc17853ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83555504-d4ce-4ca5-a153-e31136489839', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253fd9bb-9ebb-429b-8c45-9c4874b04242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:41 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Volume volume-83555504-d4ce-4ca5-a153-e31136489839 (83555504-d4ce-4ca5-a153-e31136489839): created successfully
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253fd9bb-9ebb-429b-8c45-9c4874b04242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Flow 'volume_create_manager' (c0a4ade9-c866-4507-a103-340492dcda61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:41 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-acaa65bf-81f9-45e0-be91-aeb3f9abbaea tempest-CinderUnicodeTest-195014356 None] Created volume successfully.
Nov 05 18:48:41 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9" returned: 0 in 0.413s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:41 devstack sudo[104547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9
Nov 05 18:48:41 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:41 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e5add442-90b7-493b-bbec-6952955dccf9" returned: 0 in 0.265s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-quobyte-e5add442-90b7-493b-bbec-6952955dccf9" released by "delete_volume" :: held 0.738s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:41 devstack cinder-volume[87086]: WARNING cinder.quota [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-886329429-1296760053 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-886329429-1296760053, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:48:41 devstack cinder-volume[87086]: WARNING cinder.quota [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-886329429-1296760053 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-886329429-1296760053, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Created reservations ['df4fafce-6a07-4118-ad34-1d91840df1d1', '131f66e2-ff34-4804-bcc6-096cf318bce9', 'dac35de1-a47c-4f62-aeaf-a8172033d1f3', '81320652-1837-4b66-a4a5-b9da6971fee0'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:41 devstack sudo[104550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:41 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (9a21f71e-5eb4-4252-8d4b-d27f33fbf3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c530557-4015-41b9-9b48-1f5c8b75c248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c530557-4015-41b9-9b48-1f5c8b75c248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479147327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0609c39-12b3-4661-a8ca-f09cd7765aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:42Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec41b876-41bb-45de-be61-d5fc5a4b3d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec41b876-41bb-45de-be61-d5fc5a4b3d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ad5ac9-fcea-475b-aa61-bab0f601971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ad5ac9-fcea-475b-aa61-bab0f601971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0609c39-12b3-4661-a8ca-f09cd7765aba', 'volume_name': 'volume-f0609c39-12b3-4661-a8ca-f09cd7765aba', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ae8a68-ab4d-48a9-a351-b1508714954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:41 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12ae8a68-ab4d-48a9-a351-b1508714954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2c6e41-94fd-455d-a7a6-351c5440d1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:41 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume f0609c39-12b3-4661-a8ca-f09cd7765aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0609c39-12b3-4661-a8ca-f09cd7765aba', 'volume_size': 1}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479147327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0609c39-12b3-4661-a8ca-f09cd7765aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:42Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Creating volume f0609c39-12b3-4661-a8ca-f09cd7765aba {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:41 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.400s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:41 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deleted volume successfully.
Nov 05 18:48:41 devstack sudo[104553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba 1073741824
Nov 05 18:48:41 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:41 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-997e50f1-d122-4146-b6bc-445954cdbeb3 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-e5add442-90b7-493b-bbec-6952955dccf9-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (813e2fe7-c765-4dca-b188-9e7edbc775e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1758e768-8889-499f-b21a-17a707cf3e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1758e768-8889-499f-b21a-17a707cf3e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668638297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e08a6f6-4d62-4819-8363-02312a87cce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:42Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871505f2-fff0-4a14-8ec4-43b21af1a486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871505f2-fff0-4a14-8ec4-43b21af1a486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00453a34-6512-4311-ba14-618316f4f87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00453a34-6512-4311-ba14-618316f4f87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e08a6f6-4d62-4819-8363-02312a87cce4', 'volume_name': 'volume-2e08a6f6-4d62-4819-8363-02312a87cce4', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89656e33-b448-4c17-be66-5fa61fe0a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89656e33-b448-4c17-be66-5fa61fe0a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32ed2dd-5d0c-45ad-a769-cc72dc928bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:42 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume 2e08a6f6-4d62-4819-8363-02312a87cce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e08a6f6-4d62-4819-8363-02312a87cce4', 'volume_size': 1}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:42 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba 1073741824" returned: 0 in 0.737s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:42 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba
Nov 05 18:48:42 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (b241bd37-0c82-4860-8b47-16cb6674370d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244dd701-9c8f-46e2-b715-5db5a2d5d62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244dd701-9c8f-46e2-b715-5db5a2d5d62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-708144341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d029bc-e67c-460f-ab6b-8a3ad7889b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:43Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb0f44b-17c3-4bdb-9674-bd06b159360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb0f44b-17c3-4bdb-9674-bd06b159360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a2c611-1632-4a4b-91f7-ce99c47141c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a2c611-1632-4a4b-91f7-ce99c47141c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d029bc-e67c-460f-ab6b-8a3ad7889b24', 'volume_name': 'volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c5d31e-98cb-4acc-bfcb-3324dc00976f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c5d31e-98cb-4acc-bfcb-3324dc00976f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9f7264-5b0d-4f10-9133-436353b1bbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume 17d029bc-e67c-460f-ab6b-8a3ad7889b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24', 'volume_size': 1}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:43 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba" returned: 0 in 0.460s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.631s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1668638297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e08a6f6-4d62-4819-8363-02312a87cce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:42Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Creating volume 2e08a6f6-4d62-4819-8363-02312a87cce4 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:43 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d2c6e41-94fd-455d-a7a6-351c5440d1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0609c39-12b3-4661-a8ca-f09cd7765aba', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab2ca0c-5b4c-48d7-8852-9ce69ae6c3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume volume-f0609c39-12b3-4661-a8ca-f09cd7765aba (f0609c39-12b3-4661-a8ca-f09cd7765aba): created successfully
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab2ca0c-5b4c-48d7-8852-9ce69ae6c3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (9a21f71e-5eb4-4252-8d4b-d27f33fbf3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:43 devstack sudo[104563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4 1073741824
Nov 05 18:48:43 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-88b415fd-4f2a-4204-8336-ec44d4ec8227 tempest-CreateVolumesFromSnapshotTest-690064554 None] Created volume successfully.
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Flow 'volume_create_manager' (f3972d73-54f6-4ef7-b9c3-2a89b87ee8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4607167f-1880-4a51-b179-5c1efab4d800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4607167f-1880-4a51-b179-5c1efab4d800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1139858479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8eef628-deb7-4c5d-bdaa-dff923167649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f154cbf334544b9c8591acfffe011b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:43Z,use_quota=True,user_id='392c91899cc147d5b7e33b66e9f252bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995f5ff4-b81e-4ebb-9d32-7e3dcce2f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (995f5ff4-b81e-4ebb-9d32-7e3dcce2f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad5a6c8-70ee-4e61-994e-4834c1ad637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad5a6c8-70ee-4e61-994e-4834c1ad637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8eef628-deb7-4c5d-bdaa-dff923167649', 'volume_name': 'volume-c8eef628-deb7-4c5d-bdaa-dff923167649', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9548d4-34a8-4481-aab9-aa6889da8296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9548d4-34a8-4481-aab9-aa6889da8296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d153b8-ad7a-4a12-a3d3-f30a9f7669bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Volume c8eef628-deb7-4c5d-bdaa-dff923167649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8eef628-deb7-4c5d-bdaa-dff923167649', 'volume_size': 1}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (fef850e4-3dc5-4d77-8db3-e48daa7aea57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04eef39a-e79a-4e31-9da7-6cf59527d49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04eef39a-e79a-4e31-9da7-6cf59527d49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1168179463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c61787-c000-40d2-8e09-d896aea904b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:44Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55bea34-69fd-41c8-9e99-b2ad8d84a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55bea34-69fd-41c8-9e99-b2ad8d84a187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c61b3c-6bc5-4087-a513-47737ce6a0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c61b3c-6bc5-4087-a513-47737ce6a0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c61787-c000-40d2-8e09-d896aea904b8', 'volume_name': 'volume-c0c61787-c000-40d2-8e09-d896aea904b8', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36152682-77e1-4853-af4e-4ac25c5dd1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36152682-77e1-4853-af4e-4ac25c5dd1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993c9bc5-79c7-4233-8f2e-b9b6eef39aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume c0c61787-c000-40d2-8e09-d896aea904b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c61787-c000-40d2-8e09-d896aea904b8', 'volume_size': 1}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:43 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (2d7b37bc-6d31-4284-a5c0-bb64c6fcc1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4331a74d-5aa8-4079-9ec7-3b7cf6f50ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4 1073741824" returned: 0 in 0.746s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4331a74d-5aa8-4079-9ec7-3b7cf6f50ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-594773985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29302b62-e891-40eb-9fa3-5d757b935e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:44Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c9bba0-a240-4367-9502-450b15e05cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c9bba0-a240-4367-9502-450b15e05cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3c6d53-f81c-4b34-9429-888dfb1adfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3c6d53-f81c-4b34-9429-888dfb1adfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29302b62-e891-40eb-9fa3-5d757b935e9a', 'volume_name': 'volume-29302b62-e891-40eb-9fa3-5d757b935e9a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596df729-7873-469b-ab7f-5a1abe12ff9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596df729-7873-469b-ab7f-5a1abe12ff9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77934ca-ff51-44fd-9880-ef69749e3c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:44 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume 29302b62-e891-40eb-9fa3-5d757b935e9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29302b62-e891-40eb-9fa3-5d757b935e9a', 'volume_size': 1}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:44 devstack sudo[104572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4
Nov 05 18:48:44 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:44 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4" returned: 0 in 0.316s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-708144341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d029bc-e67c-460f-ab6b-8a3ad7889b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:43Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Creating volume 17d029bc-e67c-460f-ab6b-8a3ad7889b24 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:44 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32ed2dd-5d0c-45ad-a769-cc72dc928bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e08a6f6-4d62-4819-8363-02312a87cce4', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:44 devstack sudo[104577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24 1073741824
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ebd2e8-b71a-42d5-a2b5-04a5bd3a3e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:44 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:44 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume volume-2e08a6f6-4d62-4819-8363-02312a87cce4 (2e08a6f6-4d62-4819-8363-02312a87cce4): created successfully
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ebd2e8-b71a-42d5-a2b5-04a5bd3a3e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (813e2fe7-c765-4dca-b188-9e7edbc775e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1fb21e79-5fd5-4e31-9339-85965dcc8e01 tempest-CreateVolumesFromSnapshotTest-690064554 None] Created volume successfully.
Nov 05 18:48:45 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24 1073741824" returned: 0 in 0.740s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:45 devstack sudo[104603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24
Nov 05 18:48:45 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:45 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24" returned: 0 in 0.304s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1139858479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8eef628-deb7-4c5d-bdaa-dff923167649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f154cbf334544b9c8591acfffe011b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:43Z,use_quota=True,user_id='392c91899cc147d5b7e33b66e9f252bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Creating volume c8eef628-deb7-4c5d-bdaa-dff923167649 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:45 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:45 devstack sudo[104613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649 1073741824
Nov 05 18:48:45 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9f7264-5b0d-4f10-9133-436353b1bbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64df532e-64c7-40aa-8c19-045a10a5552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:45 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24 (17d029bc-e67c-460f-ab6b-8a3ad7889b24): created successfully
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64df532e-64c7-40aa-8c19-045a10a5552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (b241bd37-0c82-4860-8b47-16cb6674370d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9812f19b-706f-4082-a782-f43c85669276 tempest-CreateVolumesFromSnapshotTest-690064554 None] Created volume successfully.
Nov 05 18:48:45 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649 1073741824" returned: 0 in 0.469s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:46 devstack sudo[104620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649
Nov 05 18:48:46 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:46 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649" returned: 0 in 0.280s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.512s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1168179463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c61787-c000-40d2-8e09-d896aea904b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:44Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Creating volume c0c61787-c000-40d2-8e09-d896aea904b8 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:46 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d153b8-ad7a-4a12-a3d3-f30a9f7669bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8eef628-deb7-4c5d-bdaa-dff923167649', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:46 devstack sudo[104624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8 1073741824
Nov 05 18:48:46 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e3dc3a-6e98-49bd-b591-5662907a6ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:46 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Volume volume-c8eef628-deb7-4c5d-bdaa-dff923167649 (c8eef628-deb7-4c5d-bdaa-dff923167649): created successfully
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e3dc3a-6e98-49bd-b591-5662907a6ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Flow 'volume_create_manager' (f3972d73-54f6-4ef7-b9c3-2a89b87ee8b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d01065a6-3782-408b-a2bb-d03443c1b738 tempest-CinderUnicodeTest-195014356 None] Created volume successfully.
Nov 05 18:48:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-9ccf6c81-2d14-4243-a61c-3fd73380262e req-f3b1b42f-98fc-470e-84cd-b7d0b44c1078 tempest-TestInstancesWithCinderVolumes-1445035719 None] Terminate volume connection completed successfully.
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-9ccf6c81-2d14-4243-a61c-3fd73380262e req-f3b1b42f-98fc-470e-84cd-b7d0b44c1078 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deleting attachment a0121a7e-016c-4181-8dc1-307043ce3743. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:48:46 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8 1073741824" returned: 0 in 0.563s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:46 devstack sudo[104630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8
Nov 05 18:48:46 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:47 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8" returned: 0 in 0.237s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.139s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-594773985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29302b62-e891-40eb-9fa3-5d757b935e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dde668f198f14012b85f1bf379e67d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:48:44Z,use_quota=True,user_id='e8f9d908196e49caa2b030f05a108126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Creating volume 29302b62-e891-40eb-9fa3-5d757b935e9a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:48:47 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:47 devstack sudo[104633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a 1073741824
Nov 05 18:48:47 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (993c9bc5-79c7-4233-8f2e-b9b6eef39aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c61787-c000-40d2-8e09-d896aea904b8', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9566fae-f21d-4a65-849a-3d92254b4297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:47 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume volume-c0c61787-c000-40d2-8e09-d896aea904b8 (c0c61787-c000-40d2-8e09-d896aea904b8): created successfully
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9566fae-f21d-4a65-849a-3d92254b4297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (fef850e4-3dc5-4d77-8db3-e48daa7aea57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7b2eee3d-7261-45b9-8a29-4788f7cdd830 tempest-CreateVolumesFromSnapshotTest-690064554 None] Created volume successfully.
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:47 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a 1073741824" returned: 0 in 0.469s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:47 devstack sudo[104639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a
Nov 05 18:48:47 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:47 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a" returned: 0 in 0.233s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.430s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77934ca-ff51-44fd-9880-ef69749e3c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29302b62-e891-40eb-9fa3-5d757b935e9a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b0e3d9-96e0-41a3-9180-7da3e96de6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Creating offline snapshot 65ccc392-e33f-4a42-9d82-27f46d25eb4c of volume c8eef628-deb7-4c5d-bdaa-dff923167649 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:48:47 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Volume volume-29302b62-e891-40eb-9fa3-5d757b935e9a (29302b62-e891-40eb-9fa3-5d757b935e9a): created successfully
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b0e3d9-96e0-41a3-9180-7da3e96de6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Flow 'volume_create_manager' (2d7b37bc-6d31-4284-a5c0-bb64c6fcc1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[90693ea3-6517-46eb-928c-eff0794c3128]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8eddf183-dff6-47d9-bea1-160cc03bb286 tempest-CreateVolumesFromSnapshotTest-690064554 None] Created volume successfully.
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "cinder-b2e48e7a-3acc-4448-9db9-646aebc47d3a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-b2e48e7a-3acc-4448-9db9-646aebc47d3a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "cinder-quobyte-b2e48e7a-3acc-4448-9db9-646aebc47d3a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:48 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649
Nov 05 18:48:48 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-quobyte-b2e48e7a-3acc-4448-9db9-646aebc47d3a" acquired by "delete_volume" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6b3e7-82c0-412c-bf6b-f056e0fbb7ef]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-29302b62-e891-40eb-9fa3-5d757b935e9a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-29302b62-e891-40eb-9fa3-5d757b935e9a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:48 devstack sudo[104644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a
Nov 05 18:48:48 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-quobyte-29302b62-e891-40eb-9fa3-5d757b935e9a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-29302b62-e891-40eb-9fa3-5d757b935e9a" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ce4b6f-c5e1-4317-9f2a-96415abf04f2]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:48 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649" returned: 0 in 0.437s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:48 devstack sudo[104650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c 1G
Nov 05 18:48:48 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:48 devstack sudo[104649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a
Nov 05 18:48:48 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:48 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a" returned: 0 in 0.446s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:48 devstack sudo[104656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a
Nov 05 18:48:48 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:48 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a" returned: 0 in 0.378s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:48 devstack sudo[104664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a
Nov 05 18:48:48 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:48 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c 1G" returned: 0 in 0.430s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8eef628-deb7-4c5d-bdaa-dff923167649 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:48 devstack sudo[104667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8eef628-deb7-4c5d-bdaa-dff923167649 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c
Nov 05 18:48:48 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:48 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2e48e7a-3acc-4448-9db9-646aebc47d3a" returned: 0 in 0.288s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-quobyte-b2e48e7a-3acc-4448-9db9-646aebc47d3a" released by "delete_volume" :: held 0.793s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:48 devstack cinder-volume[87086]: WARNING cinder.quota [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-741358947-1780401051 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-741358947-1780401051, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:48:48 devstack cinder-volume[87086]: WARNING cinder.quota [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-741358947-1780401051 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-741358947-1780401051, it is now deprecated. Please use the default quota class for default quota.
Nov 05 18:48:48 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Created reservations ['4b817b25-7f37-4e9f-8024-dee52cfeb004', '0c35d2df-dc66-4194-9b25-2b64edc1841a', '8f272edb-4b8f-47a1-bca9-6b50d1935ac7', 'ce1d3c32-d473-4624-8493-d9b8b9186b28'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:49 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-29302b62-e891-40eb-9fa3-5d757b935e9a" returned: 0 in 0.263s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-29302b62-e891-40eb-9fa3-5d757b935e9a" released by "delete_volume" :: held 0.688s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:49 devstack sudo[104670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:49 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Created reservations ['662ae57e-a27e-4c12-876c-4e7e7548dce8', 'fc10a0c3-2d16-45db-86b3-aaf6a3822e3f', '426d6dc6-e731-417f-baed-50233ee4b924', 'bf5e188b-0400-4ed7-b40f-96f4064268c9'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:49 devstack sudo[104676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:49 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:49 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8eef628-deb7-4c5d-bdaa-dff923167649 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c" returned: 0 in 0.425s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:49 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c is being set with open permissions: ugo+rw
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:49 devstack sudo[104678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c
Nov 05 18:48:49 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:49 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.304s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:49 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Deleted volume successfully.
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-49230bf5-b2ec-42ea-9d80-f3ef0b1b3ba6 tempest-TestInstancesWithCinderVolumes-1445035719 None] Lock "cinder-b2e48e7a-3acc-4448-9db9-646aebc47d3a-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-c0c61787-c000-40d2-8e09-d896aea904b8-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-c0c61787-c000-40d2-8e09-d896aea904b8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-quobyte-c0c61787-c000-40d2-8e09-d896aea904b8" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:49 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-c0c61787-c000-40d2-8e09-d896aea904b8" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.383s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:49 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Deleted volume successfully.
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfdc3ab-66dd-49b1-a8cc-58ea9a8fac33]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:49 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e65207c7-bedd-457e-8cd5-051442164304 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-29302b62-e891-40eb-9fa3-5d757b935e9a-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c" returned: 0 in 0.379s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:49 devstack sudo[104684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.info
Nov 05 18:48:49 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:49 devstack sudo[104683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8
Nov 05 18:48:49 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:49 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.info" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:49 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.info is being set with open permissions: ugo+rw
Nov 05 18:48:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:50 devstack sudo[104689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.info
Nov 05 18:48:50 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:50 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8" returned: 0 in 0.497s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:50 devstack sudo[104693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8
Nov 05 18:48:50 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:50 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.info" returned: 0 in 0.311s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:50 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-865a71fd-62d6-4dc6-a27a-3efc7aa66551 tempest-CinderUnicodeTest-195014356 None] Create snapshot completed successfully
Nov 05 18:48:50 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c0c61787-c000-40d2-8e09-d896aea904b8" returned: 0 in 0.282s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-c0c61787-c000-40d2-8e09-d896aea904b8" released by "delete_volume" :: held 0.860s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Created reservations ['15302386-6bd1-4618-bff1-08f4604317f9', '3e98ed3a-0e35-4887-993c-1273f3a102f2', '0f752e9e-4150-48d2-8300-73d61320fbfa', '7dc38ac5-b390-4079-b336-a1d5ca3077c0'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:50 devstack sudo[104697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:50 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-17d029bc-e67c-460f-ab6b-8a3ad7889b24-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-17d029bc-e67c-460f-ab6b-8a3ad7889b24-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "cinder-65ccc392-e33f-4a42-9d82-27f46d25eb4c-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-quobyte-17d029bc-e67c-460f-ab6b-8a3ad7889b24" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-65ccc392-e33f-4a42-9d82-27f46d25eb4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "cinder-quobyte-c8eef628-deb7-4c5d-bdaa-dff923167649" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-17d029bc-e67c-460f-ab6b-8a3ad7889b24" acquired by "delete_volume" :: waited 0.074s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-quobyte-c8eef628-deb7-4c5d-bdaa-dff923167649" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "cinder-quobyte-65ccc392-e33f-4a42-9d82-27f46d25eb4c" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[56067631-b700-4568-8583-3fa41a1d7f90]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-quobyte-65ccc392-e33f-4a42-9d82-27f46d25eb4c" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Deleting offline snapshot 65ccc392-e33f-4a42-9d82-27f46d25eb4c of volume c8eef628-deb7-4c5d-bdaa-dff923167649 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:48:50 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] snapshot_file for this snap is: volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.465s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:51 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Deleted volume successfully.
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb132719-6d31-4b32-9542-81dcf431d09d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-a2495027-54ca-456a-b9d6-bd654a6ceb4c tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-c0c61787-c000-40d2-8e09-d896aea904b8-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:51 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24
Nov 05 18:48:51 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:51 devstack sudo[104735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c
Nov 05 18:48:51 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:51 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c" returned: 0 in 0.492s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8eef628-deb7-4c5d-bdaa-dff923167649(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:48:51 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24" returned: 0 in 0.598s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2353a20-2a0b-44ff-9712-ba1011aaf617]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:51 devstack sudo[104747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24
Nov 05 18:48:51 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:51 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649
Nov 05 18:48:51 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:51 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-17d029bc-e67c-460f-ab6b-8a3ad7889b24" returned: 0 in 0.308s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-17d029bc-e67c-460f-ab6b-8a3ad7889b24" released by "delete_volume" :: held 0.968s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:51 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Created reservations ['b00f86c5-f0ad-43fb-ab3d-cb736ba37f01', 'c05ebc60-a91f-4979-aea6-7d6f5e9448e2', '56397140-bc0a-484e-bb5c-c32d8d26e99e', '5bc88645-7c0e-46a4-9a8f-89aaca920543'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:52 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649" returned: 0 in 0.461s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:52 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c
Nov 05 18:48:52 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:52 devstack sudo[104758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:52 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:52 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:52 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Deleted volume successfully.
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-86c9c87b-cbd4-4d2a-bd3a-69111de17fba tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-17d029bc-e67c-460f-ab6b-8a3ad7889b24-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:52 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c" returned: 0 in 0.375s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:52 devstack sudo[104765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c
Nov 05 18:48:52 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:52 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649.65ccc392-e33f-4a42-9d82-27f46d25eb4c" returned: 0 in 0.265s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-quobyte-65ccc392-e33f-4a42-9d82-27f46d25eb4c" released by "_delete_snapshot" :: held 1.758s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-quobyte-c8eef628-deb7-4c5d-bdaa-dff923167649" released by "delete_snapshot" :: held 1.805s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Created reservations ['40161c9e-bd97-4c03-80f7-6023cf87fab9', '6e5e04c8-c642-4270-abe5-3b425efd7a19', '508e266b-5698-4fb3-9417-9a099679dd68', '5abb6269-c37b-4629-8e76-78873a4850c2'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:52 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Delete snapshot completed successfully.
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eee0a227-6d26-4364-9819-13ab00677d25 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-65ccc392-e33f-4a42-9d82-27f46d25eb4c-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-2e08a6f6-4d62-4819-8363-02312a87cce4-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-2e08a6f6-4d62-4819-8363-02312a87cce4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "cinder-c8eef628-deb7-4c5d-bdaa-dff923167649-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-quobyte-2e08a6f6-4d62-4819-8363-02312a87cce4" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-2e08a6f6-4d62-4819-8363-02312a87cce4" acquired by "delete_volume" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-c8eef628-deb7-4c5d-bdaa-dff923167649-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7d9f5-618c-4d25-b02d-106b340c08a6]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "cinder-quobyte-c8eef628-deb7-4c5d-bdaa-dff923167649" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-quobyte-c8eef628-deb7-4c5d-bdaa-dff923167649" acquired by "delete_volume" :: waited 0.034s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3be5a84-8faa-4057-9b47-e3f57f4f515e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:53 devstack sudo[104768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4
Nov 05 18:48:53 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:53 devstack sudo[104769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649
Nov 05 18:48:53 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:53 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4" returned: 0 in 0.451s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:53 devstack sudo[104775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4
Nov 05 18:48:53 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:53 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649" returned: 0 in 0.401s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:53 devstack sudo[104780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649
Nov 05 18:48:53 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:53 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2e08a6f6-4d62-4819-8363-02312a87cce4" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-2e08a6f6-4d62-4819-8363-02312a87cce4" released by "delete_volume" :: held 0.786s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=176,cinder:INSERT=55,cinder:UPDATE=234,cinder:DELETE=22 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Created reservations ['d9f5c8fd-cfb1-4fa7-802c-7a31e5a30a80', '5fbeab31-b7a2-4e2b-9dc8-1d4cf00ccf06', 'd08bb4d9-37ab-4128-8f46-1974353970e4', '9aae59c5-a34f-4251-a308-5b240392f84e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:53 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c8eef628-deb7-4c5d-bdaa-dff923167649" returned: 0 in 0.308s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-quobyte-c8eef628-deb7-4c5d-bdaa-dff923167649" released by "delete_volume" :: held 0.794s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:54 devstack sudo[104784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:54 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Created reservations ['68af5546-9efa-4f2c-93e6-0f1560210c25', '58985e62-bfe1-4494-b6d2-fde8e18743f3', '390a8df2-b4c4-40cd-9feb-7543084dad5a', '76002b09-bbda-4d56-993f-edf0757b064e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:54 devstack sudo[104786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-f0609c39-12b3-4661-a8ca-f09cd7765aba-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:54 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-f0609c39-12b3-4661-a8ca-f09cd7765aba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-quobyte-f0609c39-12b3-4661-a8ca-f09cd7765aba" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "cinder-83555504-d4ce-4ca5-a153-e31136489839-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-f0609c39-12b3-4661-a8ca-f09cd7765aba" acquired by "delete_volume" :: waited 0.084s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-83555504-d4ce-4ca5-a153-e31136489839-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:54 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec54e2a7-59a1-40fe-ae9b-b53564954a7e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.509s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "cinder-quobyte-83555504-d4ce-4ca5-a153-e31136489839" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:54 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Deleted volume successfully.
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-quobyte-83555504-d4ce-4ca5-a153-e31136489839" acquired by "delete_volume" :: waited 0.049s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-860e2272-64b4-4571-9d38-a0f823d51ff9 tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-2e08a6f6-4d62-4819-8363-02312a87cce4-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5193a8b-8ee8-4c09-938d-e7c772ad9cf5]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:54 devstack sudo[104789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba
Nov 05 18:48:54 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:54 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.505s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:54 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Deleted volume successfully.
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=238,cinder:SELECT=186,cinder:DELETE=21,cinder:INSERT=63 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:48:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-62d6e33a-8d24-44ca-94eb-6a49d4469017 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-c8eef628-deb7-4c5d-bdaa-dff923167649-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:54 devstack sudo[104791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839
Nov 05 18:48:54 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:55 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba" returned: 0 in 0.471s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:55 devstack sudo[104799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba
Nov 05 18:48:55 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:55 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839" returned: 0 in 0.436s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:55 devstack sudo[104802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839
Nov 05 18:48:55 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:55 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f0609c39-12b3-4661-a8ca-f09cd7765aba" returned: 0 in 0.293s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-f0609c39-12b3-4661-a8ca-f09cd7765aba" released by "delete_volume" :: held 0.851s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Created reservations ['e9fd0c24-b5f6-4169-be12-ac2c82b2380c', '13dd56c0-c19d-451a-a22d-83a1acae8e4d', 'd45e9c0f-16c5-454b-8f51-d75e884d0bcc', '5df9acaf-8e39-4c13-9b7e-534cc2c18614'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:55 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-83555504-d4ce-4ca5-a153-e31136489839" returned: 0 in 0.316s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-quobyte-83555504-d4ce-4ca5-a153-e31136489839" released by "delete_volume" :: held 0.809s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:55 devstack sudo[104808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:55 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Created reservations ['38c45255-e538-4de6-b162-935dd51835ee', 'dfab3ccb-722c-4f15-95b2-f18e8a08f9fd', 'b4994f14-61ff-40d8-964e-db447738ba08', '01add89c-7b2a-4da2-a400-5e9aef2eaf09'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:55 devstack sudo[104810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:55 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:55 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.283s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:55 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Deleted volume successfully.
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f0b15a05-6739-4907-97f9-90c8937d221a tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-f0609c39-12b3-4661-a8ca-f09cd7765aba-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:55 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.297s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:48:55 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Deleted volume successfully.
Nov 05 18:48:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-67b963af-5a63-4d53-b84d-f493d9baadd7 tempest-CinderUnicodeTest-195014356 None] Lock "cinder-83555504-d4ce-4ca5-a153-e31136489839-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-2282e361-7da3-4488-938d-4b33e85e422f-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-2282e361-7da3-4488-938d-4b33e85e422f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-quobyte-eedfb32a-5e15-4dca-b5c6-4238751014ec" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-eedfb32a-5e15-4dca-b5c6-4238751014ec" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-quobyte-2282e361-7da3-4488-938d-4b33e85e422f" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-2282e361-7da3-4488-938d-4b33e85e422f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Deleting offline snapshot 2282e361-7da3-4488-938d-4b33e85e422f of volume eedfb32a-5e15-4dca-b5c6-4238751014ec {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:48:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] snapshot_file for this snap is: volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:48:56 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[54158055-873b-4d1a-862b-59dddd81d45f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:56 devstack sudo[104816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f
Nov 05 18:48:56 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:57 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f" returned: 0 in 0.414s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eedfb32a-5e15-4dca-b5c6-4238751014ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:48:57 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f864fd99-bece-4cd1-b4ff-21116fdf4001]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:57 devstack sudo[104821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec
Nov 05 18:48:57 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:57 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec" returned: 0 in 0.456s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:57 devstack sudo[104827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f
Nov 05 18:48:57 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:57 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f" returned: 0 in 0.394s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:57 devstack sudo[104832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f
Nov 05 18:48:57 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:58 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec.2282e361-7da3-4488-938d-4b33e85e422f" returned: 0 in 0.298s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-2282e361-7da3-4488-938d-4b33e85e422f" released by "_delete_snapshot" :: held 1.702s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-eedfb32a-5e15-4dca-b5c6-4238751014ec" released by "delete_snapshot" :: held 1.728s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Created reservations ['f2ea5571-7d90-46eb-bf3f-37c794827913', 'cd76143d-c124-4f02-9ff6-6e3e44329f11', '79f829e6-fe3a-40a7-850f-029c223a0e6f', '99067c66-71e4-4f39-a48c-c8b247c4f00b'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:58 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Delete snapshot completed successfully.
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-20b47b61-4847-49c7-8511-acc8b6ee29dc tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-2282e361-7da3-4488-938d-4b33e85e422f-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-eedfb32a-5e15-4dca-b5c6-4238751014ec-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-eedfb32a-5e15-4dca-b5c6-4238751014ec-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "cinder-quobyte-eedfb32a-5e15-4dca-b5c6-4238751014ec" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-eedfb32a-5e15-4dca-b5c6-4238751014ec" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f714a083-8312-47fa-8028-8ab8f51dc1df]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:48:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:58 devstack sudo[104835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec
Nov 05 18:48:58 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:59 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec" returned: 0 in 0.404s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:59 devstack sudo[104841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec
Nov 05 18:48:59 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:48:59 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-eedfb32a-5e15-4dca-b5c6-4238751014ec" returned: 0 in 0.387s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-quobyte-eedfb32a-5e15-4dca-b5c6-4238751014ec" released by "delete_volume" :: held 0.852s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Created reservations ['da32e35e-db0f-474c-aa08-48264d88721e', '83c9a469-b10c-402d-8536-fb1269251d7f', '499007f4-0219-4843-8bfb-f4adbe9d79cb', '951e8636-ff4e-47cf-b45e-ad688283da9e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:48:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:48:59 devstack sudo[104844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:48:59 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:00 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.304s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:00 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:49:00 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Deleted volume successfully.
Nov 05 18:49:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-da1e6eee-ec01-4db9-b62f-c3d21bfaf3ce tempest-CreateVolumesFromSnapshotTest-690064554 None] Lock "cinder-eedfb32a-5e15-4dca-b5c6-4238751014ec-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Flow 'volume_create_manager' (16ffd937-a72a-44a8-a966-deb7767be887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57451ff-58f7-495c-98fa-937a31115fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57451ff-58f7-495c-98fa-937a31115fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991207873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=417ff9db-7913-4e24-91d5-b704b4c49e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c022e882f73489493cee57f1abe346a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:01Z,use_quota=True,user_id='ac4e717a202a4e35a3063f8c040fccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229f245f-3399-4d97-b8d4-797445f04bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229f245f-3399-4d97-b8d4-797445f04bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfc55af-f3a1-40ca-9446-b7c36075c67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfc55af-f3a1-40ca-9446-b7c36075c67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '417ff9db-7913-4e24-91d5-b704b4c49e1c', 'volume_name': 'volume-417ff9db-7913-4e24-91d5-b704b4c49e1c', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2162c5c-fbcd-418d-ae86-020e729e5c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2162c5c-fbcd-418d-ae86-020e729e5c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9ce364-29e2-4531-ba26-24684f9fdecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:01 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Volume 417ff9db-7913-4e24-91d5-b704b4c49e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-417ff9db-7913-4e24-91d5-b704b4c49e1c', 'volume_size': 1}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991207873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=417ff9db-7913-4e24-91d5-b704b4c49e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c022e882f73489493cee57f1abe346a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:01Z,use_quota=True,user_id='ac4e717a202a4e35a3063f8c040fccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Creating volume 417ff9db-7913-4e24-91d5-b704b4c49e1c {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:49:01 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:01 devstack sudo[104848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c 1073741824
Nov 05 18:49:01 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:01 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c 1073741824" returned: 0 in 0.531s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:01 devstack sudo[104854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c
Nov 05 18:49:01 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:02 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c" returned: 0 in 0.261s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:49:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9ce364-29e2-4531-ba26-24684f9fdecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-417ff9db-7913-4e24-91d5-b704b4c49e1c', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1c99ad-42c8-43a6-9de7-77ce51b79f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Volume volume-417ff9db-7913-4e24-91d5-b704b4c49e1c (417ff9db-7913-4e24-91d5-b704b4c49e1c): created successfully
Nov 05 18:49:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1c99ad-42c8-43a6-9de7-77ce51b79f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Flow 'volume_create_manager' (16ffd937-a72a-44a8-a966-deb7767be887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:02 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9321e777-80f0-4f75-bd06-4cfb81626d44 tempest-ProjectReaderTests-41169511 None] Created volume successfully.
Nov 05 18:49:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Acquiring lock "cinder-417ff9db-7913-4e24-91d5-b704b4c49e1c-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Lock "cinder-417ff9db-7913-4e24-91d5-b704b4c49e1c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Acquiring lock "cinder-quobyte-417ff9db-7913-4e24-91d5-b704b4c49e1c" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:03 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Lock "cinder-quobyte-417ff9db-7913-4e24-91d5-b704b4c49e1c" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:03 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6be9e42-feba-404d-a259-2144000d1fa6]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:49:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:03 devstack sudo[104857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c
Nov 05 18:49:03 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:04 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c" returned: 0 in 0.462s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:04 devstack sudo[104862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c
Nov 05 18:49:04 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:04 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-417ff9db-7913-4e24-91d5-b704b4c49e1c" returned: 0 in 0.308s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Lock "cinder-quobyte-417ff9db-7913-4e24-91d5-b704b4c49e1c" released by "delete_volume" :: held 0.824s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Created reservations ['f193615e-223e-4895-9fca-376aa8ee3741', '1f9c6d5b-16fe-4f72-ac14-dbe560228daf', '0a9a06be-96da-4f3d-81fe-928d91c85d86', 'ced8e09a-1b97-4350-9cf5-284ea4093802'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:04 devstack sudo[104865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:49:04 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:05 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.456s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:49:05 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Deleted volume successfully.
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-93f509bf-ad18-4718-abb6-70690c2bb859 tempest-ProjectReaderTests-41169511 None] Lock "cinder-417ff9db-7913-4e24-91d5-b704b4c49e1c-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Flow 'volume_create_manager' (14279d68-d13f-4861-8391-548642031b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32f80a0-ffe0-4fc6-9c6a-63d1dc071ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32f80a0-ffe0-4fc6-9c6a-63d1dc071ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138635423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ac449e-6533-4c2b-8ecc-ed391ff74b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c022e882f73489493cee57f1abe346a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:05Z,use_quota=True,user_id='ac4e717a202a4e35a3063f8c040fccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f760d7a-fa6a-4600-995f-546cb137edfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f760d7a-fa6a-4600-995f-546cb137edfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc89875-f32c-4c5d-bb85-a2f30dec7447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc89875-f32c-4c5d-bb85-a2f30dec7447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ac449e-6533-4c2b-8ecc-ed391ff74b3a', 'volume_name': 'volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d244b9-e2b3-4b05-b46f-57b2ca3413cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d244b9-e2b3-4b05-b46f-57b2ca3413cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eda3452-d1fd-4f65-ab53-9f86850b6421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:05 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Volume 64ac449e-6533-4c2b-8ecc-ed391ff74b3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a', 'volume_size': 1}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138635423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ac449e-6533-4c2b-8ecc-ed391ff74b3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c022e882f73489493cee57f1abe346a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:05Z,use_quota=True,user_id='ac4e717a202a4e35a3063f8c040fccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Creating volume 64ac449e-6533-4c2b-8ecc-ed391ff74b3a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:49:05 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:49:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:05 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a 1073741824
Nov 05 18:49:05 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:06 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a 1073741824" returned: 0 in 0.541s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:06 devstack sudo[104875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a
Nov 05 18:49:06 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:06 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a" returned: 0 in 0.284s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:49:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eda3452-d1fd-4f65-ab53-9f86850b6421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7069bc6b-6dfb-4226-b9ff-918e2fe14ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:06 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Volume volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a (64ac449e-6533-4c2b-8ecc-ed391ff74b3a): created successfully
Nov 05 18:49:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7069bc6b-6dfb-4226-b9ff-918e2fe14ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:06 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Flow 'volume_create_manager' (14279d68-d13f-4861-8391-548642031b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:06 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-955b8645-08a6-47c8-b241-650889d91805 tempest-ProjectReaderTests-41169511 None] Created volume successfully.
Nov 05 18:49:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Acquiring lock "cinder-64ac449e-6533-4c2b-8ecc-ed391ff74b3a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Lock "cinder-64ac449e-6533-4c2b-8ecc-ed391ff74b3a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Acquiring lock "cinder-quobyte-64ac449e-6533-4c2b-8ecc-ed391ff74b3a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Lock "cinder-quobyte-64ac449e-6533-4c2b-8ecc-ed391ff74b3a" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:07 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[50675f3d-b7de-4043-abcc-0b21164d773d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:49:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:07 devstack sudo[104879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a
Nov 05 18:49:07 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:08 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a" returned: 0 in 0.452s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:08 devstack sudo[104884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a
Nov 05 18:49:08 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:08 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-64ac449e-6533-4c2b-8ecc-ed391ff74b3a" returned: 0 in 0.288s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Lock "cinder-quobyte-64ac449e-6533-4c2b-8ecc-ed391ff74b3a" released by "delete_volume" :: held 0.798s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Created reservations ['62ea18d8-3985-45ea-b73f-01c718012ab4', 'e25e9347-cdd0-4c47-b34f-98ffcf241ef0', '7ac4e9e3-c6d4-482e-91ca-05c5f65e5bf4', 'b8c7393d-754c-472d-b3c1-2e1d7c1cd2b5'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:08 devstack sudo[104887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:49:08 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:08 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.288s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:49:08 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Deleted volume successfully.
Nov 05 18:49:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d418cfe3-19b2-4591-a885-a952cb825032 tempest-ProjectReaderTests-41169511 None] Lock "cinder-64ac449e-6533-4c2b-8ecc-ed391ff74b3a-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Flow 'volume_create_manager' (74e852bf-9534-4989-a26d-7c2816ace9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1731aba2-807f-4a1f-8467-47810ddb010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1731aba2-807f-4a1f-8467-47810ddb010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-540129534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e9aee9a5b24dbbb08b397ac3ec2678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:10Z,use_quota=True,user_id='adb2279917214d1d8d64a465882d755f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9159b3ee-68dc-4b2b-8b42-58d84fa4ed1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9159b3ee-68dc-4b2b-8b42-58d84fa4ed1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31711aea-c039-4999-9d0d-595fd444369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31711aea-c039-4999-9d0d-595fd444369f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7', 'volume_name': 'volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d3ffd4-dd21-411f-ab9a-69f450f534e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d3ffd4-dd21-411f-ab9a-69f450f534e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3739277-8008-470d-8958-faba4bf5e04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:10 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Volume 37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7', 'volume_size': 1}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-540129534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e9aee9a5b24dbbb08b397ac3ec2678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:10Z,use_quota=True,user_id='adb2279917214d1d8d64a465882d755f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Creating volume 37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:49:10 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:10 devstack sudo[104890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7 1073741824
Nov 05 18:49:10 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:10 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7 1073741824" returned: 0 in 0.561s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:11 devstack sudo[104896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7
Nov 05 18:49:11 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:11 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7" returned: 0 in 0.380s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:49:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3739277-8008-470d-8958-faba4bf5e04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83598591-9ad8-4d48-83fa-01ca80cdd008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:11 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Volume volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7 (37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7): created successfully
Nov 05 18:49:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83598591-9ad8-4d48-83fa-01ca80cdd008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:11 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Flow 'volume_create_manager' (74e852bf-9534-4989-a26d-7c2816ace9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:11 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d635bcd3-dc8e-485b-b9e3-eb64486c998d tempest-ProjectReaderTests-1571055168 None] Created volume successfully.
Nov 05 18:49:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "cinder-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "cinder-quobyte-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-quobyte-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:12 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1baf70-5cb2-4306-910e-bfc2a39e5841]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:49:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:13 devstack sudo[104899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7
Nov 05 18:49:13 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:13 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7" returned: 0 in 0.513s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:13 devstack sudo[104905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7
Nov 05 18:49:13 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:13 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7" returned: 0 in 0.307s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-quobyte-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7" released by "delete_volume" :: held 0.887s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Created reservations ['2d0755a9-2462-4571-b130-85617c70520e', '6fa93166-1540-47e5-890b-f299e4cf1d07', '689ddf12-2fba-4ce5-b060-e58a64f525b3', '29f5683f-4889-4759-af72-01da1de64836'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:14 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:49:14 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:14 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.333s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:49:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Deleted volume successfully.
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f650afab-7274-4a54-b10d-8167cb27d002 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-37e8d87c-eb2f-48aa-a7b6-ec3226ab1cc7-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Flow 'volume_create_manager' (319d6778-3fe5-4041-9af8-a814b1e1cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfe210b-d284-4a6c-8e59-62a057d306fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfe210b-d284-4a6c-8e59-62a057d306fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1805314597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544d975f-917f-41f5-a061-34c0042ade4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e9aee9a5b24dbbb08b397ac3ec2678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:15Z,use_quota=True,user_id='adb2279917214d1d8d64a465882d755f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e771b1c-4a13-4e84-a7cd-9a4a525d9d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e771b1c-4a13-4e84-a7cd-9a4a525d9d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b126db-9bff-42de-b533-b0b5c355b2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b126db-9bff-42de-b533-b0b5c355b2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544d975f-917f-41f5-a061-34c0042ade4e', 'volume_name': 'volume-544d975f-917f-41f5-a061-34c0042ade4e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83129a8c-49ff-47c7-ae9b-c314dd51bcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83129a8c-49ff-47c7-ae9b-c314dd51bcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4846c69b-abb7-47c7-9e7b-9e5ed1d52938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:14 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Volume 544d975f-917f-41f5-a061-34c0042ade4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544d975f-917f-41f5-a061-34c0042ade4e', 'volume_size': 1}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1805314597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544d975f-917f-41f5-a061-34c0042ade4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e9aee9a5b24dbbb08b397ac3ec2678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:15Z,use_quota=True,user_id='adb2279917214d1d8d64a465882d755f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Creating volume 544d975f-917f-41f5-a061-34c0042ade4e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:49:14 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:49:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:14 devstack sudo[104911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e 1073741824
Nov 05 18:49:14 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:15 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e 1073741824" returned: 0 in 0.477s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:15 devstack sudo[104917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e
Nov 05 18:49:15 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:15 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e" returned: 0 in 0.266s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:49:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4846c69b-abb7-47c7-9e7b-9e5ed1d52938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544d975f-917f-41f5-a061-34c0042ade4e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b88d4a-3a32-4a59-95c9-76e8a96edd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:15 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Volume volume-544d975f-917f-41f5-a061-34c0042ade4e (544d975f-917f-41f5-a061-34c0042ade4e): created successfully
Nov 05 18:49:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b88d4a-3a32-4a59-95c9-76e8a96edd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Flow 'volume_create_manager' (319d6778-3fe5-4041-9af8-a814b1e1cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6baebd03-a068-44fd-9595-ba21256b64c8 tempest-ProjectReaderTests-1571055168 None] Created volume successfully.
Nov 05 18:49:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "cinder-544d975f-917f-41f5-a061-34c0042ade4e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-544d975f-917f-41f5-a061-34c0042ade4e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "cinder-quobyte-544d975f-917f-41f5-a061-34c0042ade4e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-quobyte-544d975f-917f-41f5-a061-34c0042ade4e" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:16 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca8181-a777-48a2-a5e8-ab7dc54058b3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:49:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:16 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e
Nov 05 18:49:16 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:17 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e" returned: 0 in 0.363s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:17 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e
Nov 05 18:49:17 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:17 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-544d975f-917f-41f5-a061-34c0042ade4e" returned: 0 in 0.249s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-quobyte-544d975f-917f-41f5-a061-34c0042ade4e" released by "delete_volume" :: held 0.668s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Created reservations ['050f1c5f-ea78-4e02-806b-f8ed5efbc458', 'ea999e2c-9ce9-4be7-90da-f994cf1690c9', 'b6f8b4e0-5c6c-47de-b866-18f8221cd5c2', '88fc9038-46ce-40c6-9f1f-4c8566dc328d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:17 devstack sudo[104929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:49:17 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:17 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.280s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:49:17 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Deleted volume successfully.
Nov 05 18:49:17 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-160663f6-9dc3-477f-9f29-16ee6d3b0153 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-544d975f-917f-41f5-a061-34c0042ade4e-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Flow 'volume_create_manager' (aa3efde0-8bcb-49c0-9a10-3e069e8eb1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d62838-6837-43a5-8e56-101de42f40c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d62838-6837-43a5-8e56-101de42f40c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595569134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39275903-1c36-45ba-8e65-a0709d230e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e9aee9a5b24dbbb08b397ac3ec2678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:18Z,use_quota=True,user_id='adb2279917214d1d8d64a465882d755f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57513966-9c20-4f41-bcdd-f77028f8a4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57513966-9c20-4f41-bcdd-f77028f8a4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c21f96b-9960-44e0-b38d-a8679b9c8f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c21f96b-9960-44e0-b38d-a8679b9c8f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39275903-1c36-45ba-8e65-a0709d230e74', 'volume_name': 'volume-39275903-1c36-45ba-8e65-a0709d230e74', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab6790d-3ece-4cc5-92f1-ebf154639a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab6790d-3ece-4cc5-92f1-ebf154639a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9ac1bc-5cb6-49a6-914f-6488d2364012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:18 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Volume 39275903-1c36-45ba-8e65-a0709d230e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39275903-1c36-45ba-8e65-a0709d230e74', 'volume_size': 1}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-595569134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39275903-1c36-45ba-8e65-a0709d230e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e9aee9a5b24dbbb08b397ac3ec2678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:18Z,use_quota=True,user_id='adb2279917214d1d8d64a465882d755f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Creating volume 39275903-1c36-45ba-8e65-a0709d230e74 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:49:18 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:49:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:18 devstack sudo[104932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74 1073741824
Nov 05 18:49:18 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:19 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74 1073741824" returned: 0 in 0.553s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:19 devstack sudo[104938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74
Nov 05 18:49:19 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:19 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74" returned: 0 in 0.276s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:49:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9ac1bc-5cb6-49a6-914f-6488d2364012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39275903-1c36-45ba-8e65-a0709d230e74', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8536221-2d93-488f-b064-d72cc664b456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:19 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Volume volume-39275903-1c36-45ba-8e65-a0709d230e74 (39275903-1c36-45ba-8e65-a0709d230e74): created successfully
Nov 05 18:49:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8536221-2d93-488f-b064-d72cc664b456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Flow 'volume_create_manager' (aa3efde0-8bcb-49c0-9a10-3e069e8eb1e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:19 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-4551ee5b-11fb-4665-bf89-680b242b7abc tempest-ProjectReaderTests-1571055168 None] Created volume successfully.
Nov 05 18:49:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "cinder-39275903-1c36-45ba-8e65-a0709d230e74-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-39275903-1c36-45ba-8e65-a0709d230e74-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "cinder-quobyte-39275903-1c36-45ba-8e65-a0709d230e74" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-quobyte-39275903-1c36-45ba-8e65-a0709d230e74" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:20 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c02665-0216-41b9-baac-d96714141591]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:49:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:20 devstack sudo[104941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74
Nov 05 18:49:20 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:21 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74" returned: 0 in 0.383s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:21 devstack sudo[104946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74
Nov 05 18:49:21 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:21 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-39275903-1c36-45ba-8e65-a0709d230e74" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-quobyte-39275903-1c36-45ba-8e65-a0709d230e74" released by "delete_volume" :: held 0.735s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Created reservations ['99877262-5359-4c5f-b9e4-46ea05b52f6c', '47b28eb1-c338-4924-a253-d51844503d95', 'c3b04967-263e-410c-9451-985e17102bb8', '5f5f4a93-6820-4f39-99bc-042cae5ff1dd'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:21 devstack sudo[104949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:49:21 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:21 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.285s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:49:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Deleted volume successfully.
Nov 05 18:49:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0e525c8a-5085-46ac-bde5-f7d4899d4788 tempest-ProjectReaderTests-1571055168 None] Lock "cinder-39275903-1c36-45ba-8e65-a0709d230e74-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Flow 'volume_create_manager' (dbbbfa2b-9945-4746-910a-9523e3585451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c4e8ad-1c76-4e28-a6ec-f054c573020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c4e8ad-1c76-4e28-a6ec-f054c573020d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190843673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e9aee9a5b24dbbb08b397ac3ec2678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:22Z,use_quota=True,user_id='adb2279917214d1d8d64a465882d755f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596303b0-eb75-45c7-b206-dc382ef1c31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596303b0-eb75-45c7-b206-dc382ef1c31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772a79d5-1743-44cd-b2b8-03b7be60bec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772a79d5-1743-44cd-b2b8-03b7be60bec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08', 'volume_name': 'volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d49ec1-4b10-4961-a879-ceb43eb9626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d49ec1-4b10-4961-a879-ceb43eb9626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce41d0f9-b1ca-47fb-9817-bc90c8f71af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:22 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Volume bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08', 'volume_size': 1}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190843673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2e9aee9a5b24dbbb08b397ac3ec2678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:22Z,use_quota=True,user_id='adb2279917214d1d8d64a465882d755f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Creating volume bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:49:22 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:22 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08 1073741824
Nov 05 18:49:22 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:22 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08 1073741824" returned: 0 in 0.444s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:22 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08
Nov 05 18:49:22 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:23 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08" returned: 0 in 0.302s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:49:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce41d0f9-b1ca-47fb-9817-bc90c8f71af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832b68c8-2233-4a6a-a7b5-81a829d08e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Volume volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08 (bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08): created successfully
Nov 05 18:49:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832b68c8-2233-4a6a-a7b5-81a829d08e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Flow 'volume_create_manager' (dbbbfa2b-9945-4746-910a-9523e3585451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2433effa-8921-4388-8a4e-33c1205d5e47 tempest-ProjectReaderTests-1571055168 None] Created volume successfully.
Nov 05 18:49:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Acquiring lock "cinder-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Lock "cinder-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Acquiring lock "cinder-quobyte-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:49:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Lock "cinder-quobyte-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08" acquired by "delete_volume" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:49:24 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[6154353c-89ed-4572-b6ec-489d10dfe0d7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:49:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:24 devstack sudo[104961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08
Nov 05 18:49:24 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:24 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08" returned: 0 in 0.377s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:24 devstack sudo[104966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08
Nov 05 18:49:24 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:25 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08" returned: 0 in 0.250s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Lock "cinder-quobyte-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08" released by "delete_volume" :: held 0.673s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Created reservations ['2f61ca6e-2d56-4448-b34c-e7a7ba24d280', '16526da8-8ab3-40a0-a489-3b8b4ce0c95c', '8a9906a4-223e-48c9-a3c5-ff405f90984f', 'af691a3e-a63f-4127-99cb-c66489579450'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:25 devstack sudo[104969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:49:25 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:25 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.283s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:49:25 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Deleted volume successfully.
Nov 05 18:49:25 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:49:25 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c61ad9a5-8cb4-4b37-ac2f-52212150bbeb tempest-ProjectReaderTests-1571055168 None] Lock "cinder-bcc51a5a-4068-43c0-8d06-8ebfa0ef8b08-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:49:25 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.285s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:49:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:49:35 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=50,cinder:INSERT=20,cinder:UPDATE=91,cinder:DELETE=9 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:49:35 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=76,cinder:INSERT=29,cinder:UPDATE=116,cinder:DELETE=7 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Flow 'volume_create_manager' (d16a64d5-23f4-4a63-b319-4156e397f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416c5242-ccfe-41d8-9574-30512514d87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416c5242-ccfe-41d8-9574-30512514d87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1413671583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5be9f3-7a12-435c-9e3d-269233c2821a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c3805432cd4d67af2f15f261e11a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:37Z,use_quota=True,user_id='bf257cbec9ef4d3f84f9490e1bdf5eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560b9cbe-dba2-447c-9e73-4b4d74b6c4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560b9cbe-dba2-447c-9e73-4b4d74b6c4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234e5dba-51cf-4576-9750-86c673251687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234e5dba-51cf-4576-9750-86c673251687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d5be9f3-7a12-435c-9e3d-269233c2821a', 'volume_name': 'volume-9d5be9f3-7a12-435c-9e3d-269233c2821a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f55a099-2ef1-44fb-9700-4bfc6abb64e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f55a099-2ef1-44fb-9700-4bfc6abb64e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637ec37a-1ed8-4b64-a299-a4df729795f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:36 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Volume 9d5be9f3-7a12-435c-9e3d-269233c2821a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d5be9f3-7a12-435c-9e3d-269233c2821a', 'volume_size': 1}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1413671583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5be9f3-7a12-435c-9e3d-269233c2821a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6c3805432cd4d67af2f15f261e11a3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:37Z,use_quota=True,user_id='bf257cbec9ef4d3f84f9490e1bdf5eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Creating volume 9d5be9f3-7a12-435c-9e3d-269233c2821a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:49:36 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:49:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:36 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a 1073741824
Nov 05 18:49:36 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:37 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a 1073741824" returned: 0 in 0.612s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:37 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a
Nov 05 18:49:37 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:37 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:37 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:49:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (637ec37a-1ed8-4b64-a299-a4df729795f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d5be9f3-7a12-435c-9e3d-269233c2821a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699e6692-2c87-403c-9b1c-6f9c186b3bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:37 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Volume volume-9d5be9f3-7a12-435c-9e3d-269233c2821a (9d5be9f3-7a12-435c-9e3d-269233c2821a): created successfully
Nov 05 18:49:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699e6692-2c87-403c-9b1c-6f9c186b3bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Flow 'volume_create_manager' (d16a64d5-23f4-4a63-b319-4156e397f88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:38 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2c09ccdc-51ae-4d84-8521-1e4bd621d794 tempest-TestMinimumBasicScenario-1594283690 None] Created volume successfully.
Nov 05 18:49:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-39f282a8-e272-46c2-af67-e9afd2a22c63 req-939ca593-3979-4f50-885a-215350a269b3 tempest-TestMinimumBasicScenario-1594283690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-39f282a8-e272-46c2-af67-e9afd2a22c63 req-939ca593-3979-4f50-885a-215350a269b3 tempest-TestMinimumBasicScenario-1594283690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [req-39f282a8-e272-46c2-af67-e9afd2a22c63 req-939ca593-3979-4f50-885a-215350a269b3 tempest-TestMinimumBasicScenario-1594283690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-39f282a8-e272-46c2-af67-e9afd2a22c63 req-939ca593-3979-4f50-885a-215350a269b3 tempest-TestMinimumBasicScenario-1594283690 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023', 'name': 'volume-9d5be9f3-7a12-435c-9e3d-269233c2821a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58451738-cdf4-4924-b20f-edbbcd6e9833', 'enforce_multipath': True} {{(pid=87086) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 18:49:40 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-39f282a8-e272-46c2-af67-e9afd2a22c63 req-939ca593-3979-4f50-885a-215350a269b3 tempest-TestMinimumBasicScenario-1594283690 None] attachment_update completed successfully.
Nov 05 18:49:50 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:49:54 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:DELETE=1 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Flow 'volume_create_manager' (ea36d0f0-31d7-4bd2-a277-633bac8cbb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92697ff-eb44-4445-bd6c-8484006d5eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92697ff-eb44-4445-bd6c-8484006d5eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1978644435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444807e3-5ed0-4bd2-932e-6c3abc0ff17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77fcbb2609345509bfc52f469b11622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:56Z,use_quota=True,user_id='e943c103304645039fbfd324073f8771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68d47cd-9c80-4824-99ee-14255e97412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68d47cd-9c80-4824-99ee-14255e97412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d99e907-4d14-4f0f-b7e5-0696911fb64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d99e907-4d14-4f0f-b7e5-0696911fb64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444807e3-5ed0-4bd2-932e-6c3abc0ff17d', 'volume_name': 'volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51fa838-04a9-4dc9-8229-8766cb4d56e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51fa838-04a9-4dc9-8229-8766cb4d56e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62712a8-90e0-4fb4-8ca3-e92ae664e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:55 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Volume 444807e3-5ed0-4bd2-932e-6c3abc0ff17d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d', 'volume_size': 1}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1978644435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444807e3-5ed0-4bd2-932e-6c3abc0ff17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77fcbb2609345509bfc52f469b11622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:49:56Z,use_quota=True,user_id='e943c103304645039fbfd324073f8771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Creating volume 444807e3-5ed0-4bd2-932e-6c3abc0ff17d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:49:55 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:49:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:56 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d 1073741824
Nov 05 18:49:56 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:56 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d 1073741824" returned: 0 in 0.611s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:56 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d
Nov 05 18:49:56 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:56 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" returned: 0 in 0.283s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:49:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:49:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62712a8-90e0-4fb4-8ca3-e92ae664e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e691ffdb-0b56-4dec-b9d5-a9a9ecd57f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:49:56 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Volume volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d (444807e3-5ed0-4bd2-932e-6c3abc0ff17d): created successfully
Nov 05 18:49:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e691ffdb-0b56-4dec-b9d5-a9a9ecd57f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:49:56 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Flow 'volume_create_manager' (ea36d0f0-31d7-4bd2-a277-633bac8cbb7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:49:56 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-466b4c1c-c456-49de-842d-45cd3f6cb9fe tempest-SnapshotDependencyTests-234593025 None] Created volume successfully.
Nov 05 18:49:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:49:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:49:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Creating offline snapshot 0bcd812e-690f-428f-8eb2-24a15482baf7 of volume 444807e3-5ed0-4bd2-932e-6c3abc0ff17d {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:49:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae184c56-5412-4c86-b4a7-d397a97a30ac]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:49:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:58 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d
Nov 05 18:49:58 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:58 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" returned: 0 in 0.398s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:58 devstack sudo[105613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 1G
Nov 05 18:49:58 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:59 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 1G" returned: 0 in 0.472s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:59 devstack sudo[105619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7
Nov 05 18:49:59 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:59 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7" returned: 0 in 0.335s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:59 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 is being set with open permissions: ugo+rw
Nov 05 18:49:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:59 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7
Nov 05 18:49:59 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:59 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7" returned: 0 in 0.258s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:49:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:49:59 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.info
Nov 05 18:49:59 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:49:59 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Nov 05 18:49:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.info" returned: 0 in 0.264s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:00 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.info is being set with open permissions: ugo+rw
Nov 05 18:50:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:00 devstack sudo[105630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.info
Nov 05 18:50:00 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:00 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.info" returned: 0 in 0.251s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:50:00 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-16822b40-51ab-4d85-a166-6f2ed3c178c2 tempest-SnapshotDependencyTests-234593025 None] Create snapshot completed successfully
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Flow 'volume_create_manager' (01205be7-44b6-454f-b87f-f58ee21464b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440f5459-32b0-42a0-b2a1-1a72e07cd025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (440f5459-32b0-42a0-b2a1-1a72e07cd025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be9e657-e2f9-4006-bd3d-598a8f6a989a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77fcbb2609345509bfc52f469b11622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0bcd812e-690f-428f-8eb2-24a15482baf7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:50:02Z,use_quota=True,user_id='e943c103304645039fbfd324073f8771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74715069-1393-43c5-b707-50b546fa0758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74715069-1393-43c5-b707-50b546fa0758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8566b7d3-ded4-4d45-9139-218881969982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8566b7d3-ded4-4d45-9139-218881969982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7be9e657-e2f9-4006-bd3d-598a8f6a989a', 'volume_name': 'volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a', 'volume_size': 1, 'snapshot_id': '0bcd812e-690f-428f-8eb2-24a15482baf7'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb472e02-f913-4ca7-bd1b-9798ed5e239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb472e02-f913-4ca7-bd1b-9798ed5e239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7878c5a1-c3d0-4235-a7e5-7281633bc17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:50:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Volume 7be9e657-e2f9-4006-bd3d-598a8f6a989a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a', 'volume_size': 1, 'snapshot_id': '0bcd812e-690f-428f-8eb2-24a15482baf7'}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "cinder-quobyte-0bcd812e-690f-428f-8eb2-24a15482baf7-7be9e657-e2f9-4006-bd3d-598a8f6a989a" by "_create_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-0bcd812e-690f-428f-8eb2-24a15482baf7-7be9e657-e2f9-4006-bd3d-598a8f6a989a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Creating volume 7be9e657-e2f9-4006-bd3d-598a8f6a989a from snapshot 0bcd812e-690f-428f-8eb2-24a15482baf7 {{(pid=87086) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "cinder-quobyte-7be9e657-e2f9-4006-bd3d-598a8f6a989a" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-7be9e657-e2f9-4006-bd3d-598a8f6a989a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] snapshot: 0bcd812e-690f-428f-8eb2-24a15482baf7, volume: 7be9e657-e2f9-4006-bd3d-598a8f6a989a,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b389c-88bf-415c-bc64-f9b7bd11c9d3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:02 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7
Nov 05 18:50:02 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:02 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7" returned: 0 in 0.355s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff45f9d-b33c-4156-aa06-3686247699d1]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:50:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:02 devstack sudo[105695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d
Nov 05 18:50:02 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:03 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" returned: 0 in 0.485s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:50:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:50:03 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:50:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:03 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a
Nov 05 18:50:03 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:10 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a" returned: 0 in 7.203s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d, size 1024.00 MB, duration 7.21 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:50:10 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Converted 1024.00 MB image at 142.10 MB/s
Nov 05 18:50:10 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a is being set with open permissions: ugo+rw
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:10 devstack sudo[105718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a
Nov 05 18:50:10 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:10 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a" returned: 0 in 0.263s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-7be9e657-e2f9-4006-bd3d-598a8f6a989a" released by "_copy_volume_from_snapshot" :: held 8.404s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-0bcd812e-690f-428f-8eb2-24a15482baf7-7be9e657-e2f9-4006-bd3d-598a8f6a989a" released by "_create_volume_from_snapshot" :: held 8.499s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.514s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7878c5a1-c3d0-4235-a7e5-7281633bc17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a', 'volume_size': 1, 'snapshot_id': '0bcd812e-690f-428f-8eb2-24a15482baf7'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d30000-71ca-4d61-9e9f-cf81de1f4be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:50:10 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Volume volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a (7be9e657-e2f9-4006-bd3d-598a8f6a989a): created successfully
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d30000-71ca-4d61-9e9f-cf81de1f4be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Flow 'volume_create_manager' (01205be7-44b6-454f-b87f-f58ee21464b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:50:10 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-bcb10dff-a5f2-4e11-a714-1b646ea92c88 tempest-SnapshotDependencyTests-234593025 None] Created volume successfully.
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "cinder-0bcd812e-690f-428f-8eb2-24a15482baf7-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-0bcd812e-690f-428f-8eb2-24a15482baf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "cinder-quobyte-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "cinder-quobyte-0bcd812e-690f-428f-8eb2-24a15482baf7" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-0bcd812e-690f-428f-8eb2-24a15482baf7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Deleting offline snapshot 0bcd812e-690f-428f-8eb2-24a15482baf7 of volume 444807e3-5ed0-4bd2-932e-6c3abc0ff17d {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] snapshot_file for this snap is: volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7b0d5f-557e-4b49-9b30-bd69fff1822a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:50:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:11 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7
Nov 05 18:50:11 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:11 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7" returned: 0 in 0.433s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:50:11 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb448e36-3d87-49f0-8f40-c95da76fed03]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:50:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:11 devstack sudo[105726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d
Nov 05 18:50:11 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:12 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" returned: 0 in 0.628s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:12 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7
Nov 05 18:50:12 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:12 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7" returned: 0 in 0.331s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:12 devstack sudo[105736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7
Nov 05 18:50:12 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:12 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d.0bcd812e-690f-428f-8eb2-24a15482baf7" returned: 0 in 0.233s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-0bcd812e-690f-428f-8eb2-24a15482baf7" released by "_delete_snapshot" :: held 1.760s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" released by "delete_snapshot" :: held 1.787s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:12 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Created reservations ['868ccde6-e1b9-4d6f-860a-e39c86e08209', '2de7900f-5aec-491b-811e-c4da2b75d7af', '9eaef075-0c9f-46cd-9cd6-29a5654fdc01', '588e88cb-74cf-49a4-b8f1-e20e54b14592'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:50:12 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Delete snapshot completed successfully.
Nov 05 18:50:12 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-13ecd18f-71a8-48a6-9361-95e37772098c tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-0bcd812e-690f-428f-8eb2-24a15482baf7-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "cinder-444807e3-5ed0-4bd2-932e-6c3abc0ff17d-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-444807e3-5ed0-4bd2-932e-6c3abc0ff17d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "cinder-quobyte-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32b10a5-2b15-4c38-a7e6-29c1b8cfcf4b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:13 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d
Nov 05 18:50:13 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:13 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" returned: 0 in 0.380s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:13 devstack sudo[105744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d
Nov 05 18:50:13 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:13 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" returned: 0 in 0.236s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-444807e3-5ed0-4bd2-932e-6c3abc0ff17d" released by "delete_volume" :: held 0.698s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Created reservations ['551ebbc5-338b-4a76-b5e8-facf675a2e48', 'c747deea-5739-47db-a828-b0ba12f9f39d', 'd68b95ab-13a5-41d1-9757-e59de3156ae1', '0577e748-c7bd-46c8-a8e9-f1430f008fe1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:50:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:14 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:50:14 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "cinder-7be9e657-e2f9-4006-bd3d-598a8f6a989a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-7be9e657-e2f9-4006-bd3d-598a8f6a989a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:14 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.352s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:50:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Deleted volume successfully.
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "cinder-quobyte-7be9e657-e2f9-4006-bd3d-598a8f6a989a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-7be9e657-e2f9-4006-bd3d-598a8f6a989a" acquired by "delete_volume" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2d807f7e-3d73-49e2-afc5-1aec79f6fdd4 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-444807e3-5ed0-4bd2-932e-6c3abc0ff17d-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6708917-335b-4aa8-8609-07a22f8dd66d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:14 devstack sudo[105750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a
Nov 05 18:50:14 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:14 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a" returned: 0 in 0.420s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:14 devstack sudo[105755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a
Nov 05 18:50:14 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:15 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7be9e657-e2f9-4006-bd3d-598a8f6a989a" returned: 0 in 0.273s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-quobyte-7be9e657-e2f9-4006-bd3d-598a8f6a989a" released by "delete_volume" :: held 0.748s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Created reservations ['335b9fa7-4513-4e6a-bdec-cfbb3c21c70e', '0ed58ede-2cf0-41ae-81ec-52076e6f1975', '13f03ada-cbc6-4e24-8d6a-5bb064990aba', 'a055a7db-6aa2-440c-8cf8-07364a7b9ec8'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:15 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:50:15 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:15 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.271s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:50:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Deleted volume successfully.
Nov 05 18:50:15 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07fe436a-29f0-424e-8dc1-49bffa7d8f30 tempest-SnapshotDependencyTests-234593025 None] Lock "cinder-7be9e657-e2f9-4006-bd3d-598a8f6a989a-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=30,cinder:SELECT=27,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=22,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:50:25 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:50:25 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:25 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.365s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:50:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:50:27 devstack cinder-volume[87086]: INFO cinder.volume.manager [req-06dcf04a-e875-4519-bf58-cee2509f0fab req-56d17ade-2879-4991-bc2a-0ed135a23707 tempest-TestMinimumBasicScenario-1594283690 None] Terminate volume connection completed successfully.
Nov 05 18:50:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [req-06dcf04a-e875-4519-bf58-cee2509f0fab req-56d17ade-2879-4991-bc2a-0ed135a23707 tempest-TestMinimumBasicScenario-1594283690 None] Deleting attachment 58451738-cdf4-4924-b20f-edbbcd6e9833. {{(pid=87086) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}}
Nov 05 18:50:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Acquiring lock "cinder-9d5be9f3-7a12-435c-9e3d-269233c2821a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Lock "cinder-9d5be9f3-7a12-435c-9e3d-269233c2821a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Acquiring lock "cinder-quobyte-9d5be9f3-7a12-435c-9e3d-269233c2821a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:50:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Lock "cinder-quobyte-9d5be9f3-7a12-435c-9e3d-269233c2821a" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:50:28 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d683ec-552a-4f85-8c8c-35e16d65d631]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:50:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:28 devstack sudo[105795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a
Nov 05 18:50:28 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:29 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a" returned: 0 in 0.370s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:29 devstack sudo[105800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a
Nov 05 18:50:29 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:29 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9d5be9f3-7a12-435c-9e3d-269233c2821a" returned: 0 in 0.294s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Lock "cinder-quobyte-9d5be9f3-7a12-435c-9e3d-269233c2821a" released by "delete_volume" :: held 0.708s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Created reservations ['e05a3e73-554f-4e7e-8e87-6e61eeb23f5f', '935240a6-3e48-4972-a4d1-67f7cc499f02', '51a86d2b-0b1d-48d8-a03f-1e8869a138c1', '18534464-75ea-4f82-8500-120df2c8f8f6'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:50:29 devstack sudo[105803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:50:29 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:50:29 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.266s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:50:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Deleted volume successfully.
Nov 05 18:50:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d409b82e-ede7-40d0-81c9-8a50318c69a3 tempest-TestMinimumBasicScenario-1594283690 None] Lock "cinder-9d5be9f3-7a12-435c-9e3d-269233c2821a-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:50:39 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=6 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:50:39 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:51:02 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:51:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Flow 'volume_create_manager' (75b210d5-e678-4c5f-a2d9-b6f5006131ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:51:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79667d52-baee-41d8-96e2-312f9215a7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79667d52-baee-41d8-96e2-312f9215a7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1394653794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f479c16-80bb-4513-ac30-29b878b0b118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff6b2479f3141e99aac89af3d4d52e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:51:03Z,use_quota=True,user_id='ab602a1aa8b94d3595440eeac7d3a7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a065bad4-7998-43ab-9076-03d97a1c032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a065bad4-7998-43ab-9076-03d97a1c032d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec72905-7dbf-4f3d-971b-b802ab084968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec72905-7dbf-4f3d-971b-b802ab084968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f479c16-80bb-4513-ac30-29b878b0b118', 'volume_name': 'volume-2f479c16-80bb-4513-ac30-29b878b0b118', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687acd93-9a3c-4965-ae55-3e37440eae89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687acd93-9a3c-4965-ae55-3e37440eae89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6380c4ba-6ec8-44db-8c60-1c93c3fe8e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:03 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Volume 2f479c16-80bb-4513-ac30-29b878b0b118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f479c16-80bb-4513-ac30-29b878b0b118', 'volume_size': 1}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1394653794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f479c16-80bb-4513-ac30-29b878b0b118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff6b2479f3141e99aac89af3d4d52e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:51:03Z,use_quota=True,user_id='ab602a1aa8b94d3595440eeac7d3a7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Creating volume 2f479c16-80bb-4513-ac30-29b878b0b118 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:51:03 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:03 devstack sudo[105883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 1073741824
Nov 05 18:51:03 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:03 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 1073741824" returned: 0 in 0.403s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:03 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118
Nov 05 18:51:03 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:03 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118" returned: 0 in 0.250s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6380c4ba-6ec8-44db-8c60-1c93c3fe8e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f479c16-80bb-4513-ac30-29b878b0b118', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585f8bd1-e868-41f0-b112-bfed41b680d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:03 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Volume volume-2f479c16-80bb-4513-ac30-29b878b0b118 (2f479c16-80bb-4513-ac30-29b878b0b118): created successfully
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585f8bd1-e868-41f0-b112-bfed41b680d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Flow 'volume_create_manager' (75b210d5-e678-4c5f-a2d9-b6f5006131ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:51:03 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1fd2e488-1e2a-4ed8-97df-e1f90fa84379 tempest-TestImageHashVerification-267497433 None] Created volume successfully.
Nov 05 18:51:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:04 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[203fd750-c0a3-4462-8277-7e1b758343b3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:04 devstack sudo[105891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118
Nov 05 18:51:04 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:05 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118" returned: 0 in 0.366s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:05 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d1fac8-6d14-4c8d-89a9-ca0debb8594e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:05 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118
Nov 05 18:51:05 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:05 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118" returned: 0 in 0.361s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 /opt/stack/data/cinder/conversion/2f479c16-80bb-4513-ac30-29b878b0b118.temp_image.67ca5f2b-b676-4ab0-a4a0-dd1b925e633dgmj5cbki.img {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:05 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 /opt/stack/data/cinder/conversion/2f479c16-80bb-4513-ac30-29b878b0b118.temp_image.67ca5f2b-b676-4ab0-a4a0-dd1b925e633dgmj5cbki.img
Nov 05 18:51:05 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:10 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 /opt/stack/data/cinder/conversion/2f479c16-80bb-4513-ac30-29b878b0b118.temp_image.67ca5f2b-b676-4ab0-a4a0-dd1b925e633dgmj5cbki.img" returned: 0 in 5.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:10 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a993ed6d-1fa2-4950-8226-fc6826cdf977]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:11 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118
Nov 05 18:51:11 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:11 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118" returned: 0 in 0.521s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:11 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/conversion/2f479c16-80bb-4513-ac30-29b878b0b118.temp_image.67ca5f2b-b676-4ab0-a4a0-dd1b925e633dgmj5cbki.img {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:51:11 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Converted 1024.00 MB image at 193.22 MB/s
Nov 05 18:51:11 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] 67ca5f2b-b676-4ab0-a4a0-dd1b925e633d was raw, no need to convert to raw {{(pid=87086) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 18:51:21 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:51:21 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:25 devstack sudo[105923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:51:25 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:25 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.279s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:51:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:51:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.865s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Uploaded volume to glance image-id: 67ca5f2b-b676-4ab0-a4a0-dd1b925e633d. {{(pid=87086) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 18:51:30 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-56a4eb20-1cfd-4ce3-9f9c-af732f8bd76b tempest-TestImageHashVerification-267497433 None] Copy volume to image completed successfully.
Nov 05 18:51:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Acquiring lock "cinder-2f479c16-80bb-4513-ac30-29b878b0b118-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Lock "cinder-2f479c16-80bb-4513-ac30-29b878b0b118-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Acquiring lock "cinder-quobyte-2f479c16-80bb-4513-ac30-29b878b0b118" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Lock "cinder-quobyte-2f479c16-80bb-4513-ac30-29b878b0b118" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:31 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe79631-a088-4d3b-aa2b-8625ee033729]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:31 devstack sudo[105927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118
Nov 05 18:51:31 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:31 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118" returned: 0 in 0.396s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:31 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118
Nov 05 18:51:31 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:32 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2f479c16-80bb-4513-ac30-29b878b0b118" returned: 0 in 0.303s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Lock "cinder-quobyte-2f479c16-80bb-4513-ac30-29b878b0b118" released by "delete_volume" :: held 0.740s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Created reservations ['681b6982-4ac7-42af-9aa3-ed0ebf4e6dab', '8cd0b432-cffe-4a16-b761-c8fa71996087', '8d698726-8bc4-4ad1-a3f9-4a068d4752c0', '86dc5f06-c99d-4de1-9c6c-07c36aca774c'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:32 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:51:32 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:32 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.251s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:51:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Deleted volume successfully.
Nov 05 18:51:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-25ec8ca4-4638-4d45-b93a-520be6484b58 tempest-TestImageHashVerification-267497433 None] Lock "cinder-2f479c16-80bb-4513-ac30-29b878b0b118-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:51:42 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:51:42 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Flow 'volume_create_manager' (784f282f-c037-4ca0-8209-0d30da80d222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db8a539-6c44-40d3-9998-17d1ac2b932d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db8a539-6c44-40d3-9998-17d1ac2b932d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-6095663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bc4ba6-a986-43bc-aac3-e2457f04bd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22aac5c36cad4050ab4ec06046333e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:51:44Z,use_quota=True,user_id='bd7116178139403c8229d30040dba180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fae4f9d-d7fd-4329-9af7-bcb1c2b466af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fae4f9d-d7fd-4329-9af7-bcb1c2b466af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31ffa27-f96a-4803-b45a-dee2355c55e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31ffa27-f96a-4803-b45a-dee2355c55e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79bc4ba6-a986-43bc-aac3-e2457f04bd32', 'volume_name': 'volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cc591e-7dad-4c0f-b0d8-48e1a2d1deea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9cc591e-7dad-4c0f-b0d8-48e1a2d1deea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bee9ab0-851d-4026-a9c0-587f4b289717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:44 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Volume 79bc4ba6-a986-43bc-aac3-e2457f04bd32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32', 'volume_size': 1}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-6095663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bc4ba6-a986-43bc-aac3-e2457f04bd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22aac5c36cad4050ab4ec06046333e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:51:44Z,use_quota=True,user_id='bd7116178139403c8229d30040dba180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Creating volume 79bc4ba6-a986-43bc-aac3-e2457f04bd32 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:51:44 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:51:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:44 devstack sudo[105949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 1073741824
Nov 05 18:51:44 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:45 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 1073741824" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:45 devstack sudo[105954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32
Nov 05 18:51:45 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:45 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32" returned: 0 in 0.267s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bee9ab0-851d-4026-a9c0-587f4b289717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273e6bf9-7ed9-4b2d-9255-1d07296f5d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:45 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Volume volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 (79bc4ba6-a986-43bc-aac3-e2457f04bd32): created successfully
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273e6bf9-7ed9-4b2d-9255-1d07296f5d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Flow 'volume_create_manager' (784f282f-c037-4ca0-8209-0d30da80d222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:51:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-018865ec-a4a4-4890-95b6-d07ad1b1c7c5 tempest-VolumeDependencyTests-39677123 None] Created volume successfully.
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Creating offline snapshot aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 of volume 79bc4ba6-a986-43bc-aac3-e2457f04bd32 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5930c9-5887-4395-86bb-4c3f3574e246]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:45 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32
Nov 05 18:51:45 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:46 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:46 devstack sudo[105969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 1G
Nov 05 18:51:46 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:46 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 1G" returned: 0 in 0.404s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:46 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5
Nov 05 18:51:46 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:46 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5" returned: 0 in 0.325s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:46 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 is being set with open permissions: ugo+rw
Nov 05 18:51:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:46 devstack sudo[105980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5
Nov 05 18:51:46 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:47 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5" returned: 0 in 0.258s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:47 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.info
Nov 05 18:51:47 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:47 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.info" returned: 0 in 0.259s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:47 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.info is being set with open permissions: ugo+rw
Nov 05 18:51:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:47 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.info
Nov 05 18:51:47 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:47 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.info" returned: 0 in 0.235s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6759e7fe-13a3-4a9b-a0f0-cd9e4ed3c82b tempest-VolumeDependencyTests-39677123 None] Create snapshot completed successfully
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Flow 'volume_create_manager' (7d6de9d3-0303-445c-b9e5-16826fa53aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6748d675-dd00-4116-8491-65120914bf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6748d675-dd00-4116-8491-65120914bf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1125716894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a76fe5f-a626-42eb-9113-7b8dcac1667b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22aac5c36cad4050ab4ec06046333e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aaad9ef7-ac60-4ff4-a32c-bbbf749131a5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:51:48Z,use_quota=True,user_id='bd7116178139403c8229d30040dba180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38f20e2-3a7e-43c2-abe9-ef72b1033040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b38f20e2-3a7e-43c2-abe9-ef72b1033040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e1ff97-123e-43b0-8101-684d45e15fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e1ff97-123e-43b0-8101-684d45e15fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a76fe5f-a626-42eb-9113-7b8dcac1667b', 'volume_name': 'volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b', 'volume_size': 1, 'snapshot_id': 'aaad9ef7-ac60-4ff4-a32c-bbbf749131a5'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8c706c-d5d4-4e39-8456-eb8cca3b7a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8c706c-d5d4-4e39-8456-eb8cca3b7a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f53ba1-f869-462b-9851-6ded7912a01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:48 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Volume 7a76fe5f-a626-42eb-9113-7b8dcac1667b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b', 'volume_size': 1, 'snapshot_id': 'aaad9ef7-ac60-4ff4-a32c-bbbf749131a5'}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "cinder-quobyte-aaad9ef7-ac60-4ff4-a32c-bbbf749131a5-7a76fe5f-a626-42eb-9113-7b8dcac1667b" by "_create_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-aaad9ef7-ac60-4ff4-a32c-bbbf749131a5-7a76fe5f-a626-42eb-9113-7b8dcac1667b" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Creating volume 7a76fe5f-a626-42eb-9113-7b8dcac1667b from snapshot aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 {{(pid=87086) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "cinder-quobyte-7a76fe5f-a626-42eb-9113-7b8dcac1667b" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-7a76fe5f-a626-42eb-9113-7b8dcac1667b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] snapshot: aaad9ef7-ac60-4ff4-a32c-bbbf749131a5, volume: 7a76fe5f-a626-42eb-9113-7b8dcac1667b,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[113c99cc-e869-4ab7-832b-8ca9fc1d5190]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:48 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5
Nov 05 18:51:48 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:48 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5" returned: 0 in 0.386s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7009505-f0ef-4ce7-8316-47bf57e58f58]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:49 devstack sudo[105994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32
Nov 05 18:51:49 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:49 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32" returned: 0 in 0.392s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:51:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:51:49 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:51:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:49 devstack sudo[105999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b
Nov 05 18:51:49 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:54 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b" returned: 0 in 5.597s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:54 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:51:54 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Converted 1024.00 MB image at 182.92 MB/s
Nov 05 18:51:54 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b is being set with open permissions: ugo+rw
Nov 05 18:51:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:55 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b
Nov 05 18:51:55 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:55 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b" returned: 0 in 0.237s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-7a76fe5f-a626-42eb-9113-7b8dcac1667b" released by "_copy_volume_from_snapshot" :: held 6.697s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-aaad9ef7-ac60-4ff4-a32c-bbbf749131a5-7a76fe5f-a626-42eb-9113-7b8dcac1667b" released by "_create_volume_from_snapshot" :: held 6.763s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.783s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f53ba1-f869-462b-9851-6ded7912a01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b', 'volume_size': 1, 'snapshot_id': 'aaad9ef7-ac60-4ff4-a32c-bbbf749131a5'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a45b334-9060-4ba0-b6dc-b111c300ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:51:55 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Volume volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b (7a76fe5f-a626-42eb-9113-7b8dcac1667b): created successfully
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a45b334-9060-4ba0-b6dc-b111c300ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Flow 'volume_create_manager' (7d6de9d3-0303-445c-b9e5-16826fa53aa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:51:55 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ad943ed6-8720-47fe-a3b1-8d83841e76e8 tempest-VolumeDependencyTests-39677123 None] Created volume successfully.
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Acquiring lock "cinder-aaad9ef7-ac60-4ff4-a32c-bbbf749131a5-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Lock "cinder-aaad9ef7-ac60-4ff4-a32c-bbbf749131a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Acquiring lock "cinder-quobyte-79bc4ba6-a986-43bc-aac3-e2457f04bd32" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-79bc4ba6-a986-43bc-aac3-e2457f04bd32" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Acquiring lock "cinder-quobyte-aaad9ef7-ac60-4ff4-a32c-bbbf749131a5" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-aaad9ef7-ac60-4ff4-a32c-bbbf749131a5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Deleting offline snapshot aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 of volume 79bc4ba6-a986-43bc-aac3-e2457f04bd32 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] snapshot_file for this snap is: volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[338a235e-c388-4150-9f6f-2f8a5f6bc675]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:56 devstack sudo[106052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5
Nov 05 18:51:56 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:56 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5" returned: 0 in 0.432s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:51:56 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63b7884-cd06-41e6-9c16-6795ac5f82b3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:56 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32
Nov 05 18:51:56 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:56 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32" returned: 0 in 0.554s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:57 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5
Nov 05 18:51:57 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:57 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5" returned: 0 in 0.383s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:57 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5
Nov 05 18:51:57 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:57 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32.aaad9ef7-ac60-4ff4-a32c-bbbf749131a5" returned: 0 in 0.233s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-aaad9ef7-ac60-4ff4-a32c-bbbf749131a5" released by "_delete_snapshot" :: held 1.705s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:51:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-79bc4ba6-a986-43bc-aac3-e2457f04bd32" released by "delete_snapshot" :: held 1.727s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:51:57 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Created reservations ['8d77803b-f8ab-4012-b967-6d2387581e08', '2f35835d-15ec-44ef-834c-3993e5c4defe', 'bb276d61-92cd-4d72-9075-24e767101a74', '934c577a-8ca1-4a86-b0c5-ea52700bcc3a'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:51:57 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Delete snapshot completed successfully.
Nov 05 18:51:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-daf45a33-3946-4dcc-9a2c-c933213cba7c tempest-VolumeDependencyTests-39677123 None] Lock "cinder-aaad9ef7-ac60-4ff4-a32c-bbbf749131a5-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "cinder-79bc4ba6-a986-43bc-aac3-e2457f04bd32-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-79bc4ba6-a986-43bc-aac3-e2457f04bd32-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "cinder-quobyte-79bc4ba6-a986-43bc-aac3-e2457f04bd32" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-79bc4ba6-a986-43bc-aac3-e2457f04bd32" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade0bb1-d347-4878-be3b-239383d578e8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:58 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32
Nov 05 18:51:58 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:58 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:58 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32
Nov 05 18:51:58 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:58 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79bc4ba6-a986-43bc-aac3-e2457f04bd32" returned: 0 in 0.256s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-79bc4ba6-a986-43bc-aac3-e2457f04bd32" released by "delete_volume" :: held 0.682s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Created reservations ['2d411ef0-cf30-422b-bd50-55f4756ac1b9', 'cdc6499d-476b-43f9-949c-8ad8969c1983', '85d8d99a-9152-44c2-bde7-6c93d778628b', '76c353b1-34c1-460b-a3b9-60bfb57840b6'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:51:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:58 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:51:58 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:59 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.255s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:51:59 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Deleted volume successfully.
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6860ac32-92d8-4f99-900b-b0535c5c89b6 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-79bc4ba6-a986-43bc-aac3-e2457f04bd32-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "cinder-7a76fe5f-a626-42eb-9113-7b8dcac1667b-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-7a76fe5f-a626-42eb-9113-7b8dcac1667b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "cinder-quobyte-7a76fe5f-a626-42eb-9113-7b8dcac1667b" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-7a76fe5f-a626-42eb-9113-7b8dcac1667b" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[945d96c9-6386-4995-b9be-e4d9bfcdeba2]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:59 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b
Nov 05 18:51:59 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:59 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b" returned: 0 in 0.356s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:51:59 devstack sudo[106088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b
Nov 05 18:51:59 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:51:59 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-7a76fe5f-a626-42eb-9113-7b8dcac1667b" returned: 0 in 0.252s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:51:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-quobyte-7a76fe5f-a626-42eb-9113-7b8dcac1667b" released by "delete_volume" :: held 0.648s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:00 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Created reservations ['e0cbfdb6-cf9c-472f-a00a-24e7cfa75f7e', 'f4f2c1b3-13dd-452f-b4ea-3b9bbeaefe7a', '194abe8f-2431-435f-91bf-9c978362ffc8', 'a6084d06-a7ab-492e-841a-23cad97231c2'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:00 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:00 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:00 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.229s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:00 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:00 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Deleted volume successfully.
Nov 05 18:52:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ff2a980a-d6c1-4569-9af1-a94ca2af8a54 tempest-VolumeDependencyTests-39677123 None] Lock "cinder-7a76fe5f-a626-42eb-9113-7b8dcac1667b-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:10 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=21,cinder:UPDATE=31,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:52:10 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=29,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:52:12 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Flow 'volume_create_manager' (c9f259fd-8996-45e1-bea1-20259cba988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85464e56-dd44-4ece-9563-04a1f7beea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85464e56-dd44-4ece-9563-04a1f7beea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43edb71b-96f1-4c3d-ae00-d7bc57081864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5769f17a705b4b33b68c880aa0b02515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:13Z,use_quota=True,user_id='081bda12dddc4b6c93e98b837f16f559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8eca196-232c-4748-880d-a4e27cbbdf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8eca196-232c-4748-880d-a4e27cbbdf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb47891e-488f-4b56-bac7-a52deddad405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb47891e-488f-4b56-bac7-a52deddad405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43edb71b-96f1-4c3d-ae00-d7bc57081864', 'volume_name': 'volume-43edb71b-96f1-4c3d-ae00-d7bc57081864', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212efcc9-354b-45b2-901a-c873f0a8a5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212efcc9-354b-45b2-901a-c873f0a8a5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3d6601-3967-4417-93d9-5b9be95efaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Volume 43edb71b-96f1-4c3d-ae00-d7bc57081864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43edb71b-96f1-4c3d-ae00-d7bc57081864', 'volume_size': 1}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43edb71b-96f1-4c3d-ae00-d7bc57081864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5769f17a705b4b33b68c880aa0b02515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:13Z,use_quota=True,user_id='081bda12dddc4b6c93e98b837f16f559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Creating volume 43edb71b-96f1-4c3d-ae00-d7bc57081864 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:13 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:13 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864 1073741824
Nov 05 18:52:13 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (bc64cb80-543b-43de-9d3a-bb216dfc5d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede63544-a7b3-4616-bb42-6f9c6bc96aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede63544-a7b3-4616-bb42-6f9c6bc96aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-515629626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0189062-8484-46f5-8b21-00f22609384a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:13Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d2c8e3-ccb4-4f6c-ab9a-546a9f7795dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d2c8e3-ccb4-4f6c-ab9a-546a9f7795dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9176203-d46f-43fe-a0ca-bddfe0f6e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9176203-d46f-43fe-a0ca-bddfe0f6e827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0189062-8484-46f5-8b21-00f22609384a', 'volume_name': 'volume-e0189062-8484-46f5-8b21-00f22609384a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3ef5b9-7529-41cb-9afd-c06f703fa87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3ef5b9-7529-41cb-9afd-c06f703fa87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d93d79-0ce3-4944-ae34-db213ed12248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume e0189062-8484-46f5-8b21-00f22609384a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0189062-8484-46f5-8b21-00f22609384a', 'volume_size': 1}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Flow 'volume_create_manager' (b341125c-12c4-44be-a68f-355970ce9b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58caa43-01e2-463a-99c2-ddb45b0b49c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58caa43-01e2-463a-99c2-ddb45b0b49c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1054723292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8716358-3138-46cf-ae86-aea3a38a1635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79436547c65c47bc8cec08a95a91cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:13Z,use_quota=True,user_id='8691c57c01d24568a3a7199b73fa0b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0716e5-13f2-493c-a329-5fa555086c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0716e5-13f2-493c-a329-5fa555086c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22732084-e0c9-4b4c-85f2-f4aabf71ff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22732084-e0c9-4b4c-85f2-f4aabf71ff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8716358-3138-46cf-ae86-aea3a38a1635', 'volume_name': 'volume-d8716358-3138-46cf-ae86-aea3a38a1635', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e4f8dd-f9c4-44a7-a5ee-ee6a0b4cff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e4f8dd-f9c4-44a7-a5ee-ee6a0b4cff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8a2d9e-5d7e-4ef1-a24f-ae33c358a778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Volume d8716358-3138-46cf-ae86-aea3a38a1635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8716358-3138-46cf-ae86-aea3a38a1635', 'volume_size': 1}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:13 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864 1073741824" returned: 0 in 0.674s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:13 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864
Nov 05 18:52:13 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Flow 'volume_create_manager' (c81accb0-d701-4e7d-b1c5-5e5678a3ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f58001-406d-4ec5-be8f-c1638785d3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f58001-406d-4ec5-be8f-c1638785d3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-216323212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1666daa-d260-4c66-9ab0-fe98690dbc8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79436547c65c47bc8cec08a95a91cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:14Z,use_quota=True,user_id='8691c57c01d24568a3a7199b73fa0b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae873e2-9d55-42a6-a49e-c3a0f9dc8624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae873e2-9d55-42a6-a49e-c3a0f9dc8624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8626d5b7-16e7-4ebf-a9be-b9e932cfea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8626d5b7-16e7-4ebf-a9be-b9e932cfea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1666daa-d260-4c66-9ab0-fe98690dbc8e', 'volume_name': 'volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0aecca-157c-4583-a5c4-54e8baaae104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0aecca-157c-4583-a5c4-54e8baaae104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6481ff6a-750f-4909-a339-796be8fe10f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:13 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Volume c1666daa-d260-4c66-9ab0-fe98690dbc8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e', 'volume_size': 1}
Nov 05 18:52:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:14 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864" returned: 0 in 0.375s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.952s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-515629626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0189062-8484-46f5-8b21-00f22609384a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:13Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Creating volume e0189062-8484-46f5-8b21-00f22609384a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:14 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3d6601-3967-4417-93d9-5b9be95efaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43edb71b-96f1-4c3d-ae00-d7bc57081864', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeaa6dec-0040-4bd5-8e32-2cf625d5e949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:14 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a 1073741824
Nov 05 18:52:14 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:14 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Volume volume-43edb71b-96f1-4c3d-ae00-d7bc57081864 (43edb71b-96f1-4c3d-ae00-d7bc57081864): created successfully
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeaa6dec-0040-4bd5-8e32-2cf625d5e949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Flow 'volume_create_manager' (c9f259fd-8996-45e1-bea1-20259cba988d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-87f460b7-b7c7-4914-8c09-dd59a4ec982b tempest-CinderUnicodeTest-1224633453 None] Created volume successfully.
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Flow 'volume_create_manager' (8d08f0cd-d5e2-4604-a0fd-ac4181d7a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad27f03-b5b9-42cf-b54c-20279e61909d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad27f03-b5b9-42cf-b54c-20279e61909d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-535722943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79436547c65c47bc8cec08a95a91cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:14Z,use_quota=True,user_id='8691c57c01d24568a3a7199b73fa0b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba5c62f-c33a-4cd0-a88e-078991f7632c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba5c62f-c33a-4cd0-a88e-078991f7632c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54511909-033e-441b-b9f4-c3d117dcf04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54511909-033e-441b-b9f4-c3d117dcf04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d', 'volume_name': 'volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db61b621-7eda-4b2b-b6cd-f4fee8cdc676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db61b621-7eda-4b2b-b6cd-f4fee8cdc676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5683a96a-71b7-4ae3-b195-e84995ad842b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:14 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Volume c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d', 'volume_size': 1}
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:14 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a 1073741824" returned: 0 in 0.775s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:15 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a
Nov 05 18:52:15 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Flow 'volume_create_manager' (e288f979-b0ef-471f-8fb8-5e7ad073e4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af010371-9521-4e21-a804-925640a5752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af010371-9521-4e21-a804-925640a5752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-347412799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6043a16-2a35-439d-a64b-9f6b7ee4b83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79436547c65c47bc8cec08a95a91cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:15Z,use_quota=True,user_id='8691c57c01d24568a3a7199b73fa0b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ed6ed3-4ca1-4d6f-acc3-fa43f570db74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ed6ed3-4ca1-4d6f-acc3-fa43f570db74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bda470c-e233-409a-bd25-c9575bdc53da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bda470c-e233-409a-bd25-c9575bdc53da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6043a16-2a35-439d-a64b-9f6b7ee4b83e', 'volume_name': 'volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29798f46-b256-4d43-9451-72d343601b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29798f46-b256-4d43-9451-72d343601b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc309a97-1315-4940-9e52-5952484bdf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Volume d6043a16-2a35-439d-a64b-9f6b7ee4b83e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e', 'volume_size': 1}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:15 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Flow 'volume_create_manager' (0b80b657-daaf-4184-a628-387a895fdc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04f0437-aeb4-4870-9f69-70f604bb2850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a" returned: 0 in 0.485s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.996s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1054723292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8716358-3138-46cf-ae86-aea3a38a1635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79436547c65c47bc8cec08a95a91cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:13Z,use_quota=True,user_id='8691c57c01d24568a3a7199b73fa0b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Creating volume d8716358-3138-46cf-ae86-aea3a38a1635 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:15 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:15 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635 1073741824
Nov 05 18:52:15 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b04f0437-aeb4-4870-9f69-70f604bb2850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1503233058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6542aaa-c0f1-4250-a8eb-095d35a7a4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79436547c65c47bc8cec08a95a91cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:15Z,use_quota=True,user_id='8691c57c01d24568a3a7199b73fa0b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f4b69e-8b00-4446-b010-55f38534f1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f4b69e-8b00-4446-b010-55f38534f1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76e5d89-333f-4236-88bb-f76851368f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76e5d89-333f-4236-88bb-f76851368f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6542aaa-c0f1-4250-a8eb-095d35a7a4b3', 'volume_name': 'volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ae6ba1-423d-4412-83fd-cf8ed066f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ae6ba1-423d-4412-83fd-cf8ed066f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d22af44-77ac-4861-b505-681493764221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Volume e6542aaa-c0f1-4250-a8eb-095d35a7a4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3', 'volume_size': 1}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d93d79-0ce3-4944-ae34-db213ed12248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0189062-8484-46f5-8b21-00f22609384a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55ee459-4c05-4145-bd05-51889af9604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume volume-e0189062-8484-46f5-8b21-00f22609384a (e0189062-8484-46f5-8b21-00f22609384a): created successfully
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b55ee459-4c05-4145-bd05-51889af9604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (bc64cb80-543b-43de-9d3a-bb216dfc5d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f563a184-ee8b-45a5-b3bc-237f97121cc4 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created volume successfully.
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Flow 'volume_create_manager' (616411b2-3146-4917-867f-3326179df331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811391cd-b327-404f-a2a1-0ead11aba765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811391cd-b327-404f-a2a1-0ead11aba765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1576492820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b98011-ac84-4f77-86a6-843994169f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5769f17a705b4b33b68c880aa0b02515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:16Z,use_quota=True,user_id='081bda12dddc4b6c93e98b837f16f559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a2e6e5-9190-4225-a5e8-4389dc91ef37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a2e6e5-9190-4225-a5e8-4389dc91ef37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d154c3-06b7-4ee2-99fa-a9c2e024d8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d154c3-06b7-4ee2-99fa-a9c2e024d8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b98011-ac84-4f77-86a6-843994169f8b', 'volume_name': 'volume-b2b98011-ac84-4f77-86a6-843994169f8b', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7882ef93-b65b-4cdb-a94f-a9b29bddd0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7882ef93-b65b-4cdb-a94f-a9b29bddd0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f5cad9-f1f9-4be7-8217-a0759c74af9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:15 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Volume b2b98011-ac84-4f77-86a6-843994169f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b98011-ac84-4f77-86a6-843994169f8b', 'volume_size': 1}
Nov 05 18:52:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:16 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635 1073741824" returned: 0 in 0.532s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:16 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635
Nov 05 18:52:16 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:16 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635" returned: 0 in 0.308s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.443s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-216323212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1666daa-d260-4c66-9ab0-fe98690dbc8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79436547c65c47bc8cec08a95a91cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:14Z,use_quota=True,user_id='8691c57c01d24568a3a7199b73fa0b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Creating volume c1666daa-d260-4c66-9ab0-fe98690dbc8e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:16 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8a2d9e-5d7e-4ef1-a24f-ae33c358a778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8716358-3138-46cf-ae86-aea3a38a1635', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad71f192-4f0b-4956-98f9-238081dc0673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:16 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e 1073741824
Nov 05 18:52:16 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:16 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Volume volume-d8716358-3138-46cf-ae86-aea3a38a1635 (d8716358-3138-46cf-ae86-aea3a38a1635): created successfully
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad71f192-4f0b-4956-98f9-238081dc0673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Flow 'volume_create_manager' (b341125c-12c4-44be-a68f-355970ce9b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:16 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a398c8fb-808a-42d0-8d87-93795637d8a9 tempest-CreateVolumesFromImageTest-1689353103 None] Created volume successfully.
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (5f451ffe-8783-494b-aa56-91b8b9866761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34194a6-eba2-4b59-9e3b-fa7eae20371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34194a6-eba2-4b59-9e3b-fa7eae20371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1238995475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c740ec97-6130-4fe3-8570-8815ab31e140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:16Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1d0602-04ff-4a49-8440-991221b73566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1d0602-04ff-4a49-8440-991221b73566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e217adbb-398a-45f0-ba44-22951f9b2287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e217adbb-398a-45f0-ba44-22951f9b2287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c740ec97-6130-4fe3-8570-8815ab31e140', 'volume_name': 'volume-c740ec97-6130-4fe3-8570-8815ab31e140', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284a24e2-e560-48ce-a1cc-5f7f04a63173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284a24e2-e560-48ce-a1cc-5f7f04a63173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad69af6-9de9-4128-a560-b83d2356fb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:16 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume c740ec97-6130-4fe3-8570-8815ab31e140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c740ec97-6130-4fe3-8570-8815ab31e140', 'volume_size': 1}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:16 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (ef9b59b5-b42a-4f55-a7fb-4e6ae7420e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7243c4-8ce4-4a18-9fa5-320be4e74556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd7243c4-8ce4-4a18-9fa5-320be4e74556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-518455204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c44e90f-ec4a-4149-a3a1-518a303ad8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:17Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5de0b71-8516-4184-be14-2b2f57ea029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5de0b71-8516-4184-be14-2b2f57ea029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f029ed-ba14-47a4-b9f4-bce1f9bcad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f029ed-ba14-47a4-b9f4-bce1f9bcad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c44e90f-ec4a-4149-a3a1-518a303ad8e0', 'volume_name': 'volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4875898e-74ff-45d0-9293-57441b5048bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4875898e-74ff-45d0-9293-57441b5048bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640521e0-da87-47cf-9301-d43f88579fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume 4c44e90f-ec4a-4149-a3a1-518a303ad8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0', 'volume_size': 1}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:17 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e 1073741824" returned: 0 in 0.742s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:17 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e
Nov 05 18:52:17 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (728b0c9c-7699-42e5-acec-3a3fc491e2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726b24b9-a9a7-435f-8daa-50c8ff11e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726b24b9-a9a7-435f-8daa-50c8ff11e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1124260834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e88a001-31aa-4fdb-ba87-5d445f8d5571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:17Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3d631a-3ddc-4776-912e-bdf216bbb950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3d631a-3ddc-4776-912e-bdf216bbb950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f3d959-399c-4d2f-830e-8d4e4d912340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f3d959-399c-4d2f-830e-8d4e4d912340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e88a001-31aa-4fdb-ba87-5d445f8d5571', 'volume_name': 'volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f753f37-73a5-41f0-bdfd-3b9e179b7bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f753f37-73a5-41f0-bdfd-3b9e179b7bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62eb1c01-03c4-4b3e-afe9-1acf96506296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume 9e88a001-31aa-4fdb-ba87-5d445f8d5571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571', 'volume_size': 1}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:17 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e" returned: 0 in 0.348s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.079s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-535722943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79436547c65c47bc8cec08a95a91cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:14Z,use_quota=True,user_id='8691c57c01d24568a3a7199b73fa0b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Creating volume c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:17 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:17 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d 1073741824
Nov 05 18:52:17 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6481ff6a-750f-4909-a339-796be8fe10f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c59c65-ca18-4f34-9136-40babccb4305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:17 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Volume volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e (c1666daa-d260-4c66-9ab0-fe98690dbc8e): created successfully
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c59c65-ca18-4f34-9136-40babccb4305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:17 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Flow 'volume_create_manager' (c81accb0-d701-4e7d-b1c5-5e5678a3ab58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:17 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-83c94a93-33da-42f0-9257-81676f431fc8 tempest-CreateVolumesFromImageTest-1689353103 None] Created volume successfully.
Nov 05 18:52:18 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d 1073741824" returned: 0 in 0.668s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:18 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d
Nov 05 18:52:18 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (5449c7cd-9070-48fe-903e-c4222892a6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ed3eaf-cf9f-4d2f-8f3e-6bcd83e1d7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ed3eaf-cf9f-4d2f-8f3e-6bcd83e1d7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894437104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52775e15-e04b-4609-94e6-c9feae862523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:18Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed588ef-99dd-40d6-93cc-ff37b262763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed588ef-99dd-40d6-93cc-ff37b262763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f0e69d-81d3-49b5-ba53-c56c44b57412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f0e69d-81d3-49b5-ba53-c56c44b57412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52775e15-e04b-4609-94e6-c9feae862523', 'volume_name': 'volume-52775e15-e04b-4609-94e6-c9feae862523', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9747df70-5fff-485d-9800-193831bda795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9747df70-5fff-485d-9800-193831bda795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fb4fb4-dc26-4a2a-b58a-d16a1fd3a0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume 52775e15-e04b-4609-94e6-c9feae862523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52775e15-e04b-4609-94e6-c9feae862523', 'volume_size': 1}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Flow 'volume_create_manager' (ca62501a-ed39-464c-9437-94872f66f903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e303b98-c827-40e8-81c7-e65cda849992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e303b98-c827-40e8-81c7-e65cda849992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6530f06-1228-453d-909f-8fbbee288af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351d4f2136474f61a53f74a86045f1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:18Z,use_quota=True,user_id='84caabcea8d94cef97be3781e40b57fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fe2ab31-18ed-4a35-913e-9d4292cf3117),volume_type_id=8fe2ab31-18ed-4a35-913e-9d4292cf3117)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb2cd36-e66d-474f-aff5-1bc271150527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb2cd36-e66d-474f-aff5-1bc271150527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bb3a85-c5c0-4972-944f-c8102995dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.image.glance [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Creating Keystone auth plugin from conf {{(pid=87086) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 18:52:18 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d" returned: 0 in 0.296s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.324s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-347412799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6043a16-2a35-439d-a64b-9f6b7ee4b83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79436547c65c47bc8cec08a95a91cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:15Z,use_quota=True,user_id='8691c57c01d24568a3a7199b73fa0b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Creating volume d6043a16-2a35-439d-a64b-9f6b7ee4b83e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:18 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:18 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e 1073741824
Nov 05 18:52:18 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (467344d8-53e0-4114-ae66-568dd642ac9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4707370d-afea-44cd-85a5-57610cca2112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5683a96a-71b7-4ae3-b195-e84995ad842b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bce4082-9e95-4a95-a4fe-c51f38f7e1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4707370d-afea-44cd-85a5-57610cca2112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-968132659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376695d4-952e-4b95-bcf0-3653b1d07e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:19Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ad6458-73c1-46e6-ba53-fd8ea80e75cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ad6458-73c1-46e6-ba53-fd8ea80e75cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e05c565-573b-43b0-ad80-72479d0045f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e05c565-573b-43b0-ad80-72479d0045f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376695d4-952e-4b95-bcf0-3653b1d07e7d', 'volume_name': 'volume-376695d4-952e-4b95-bcf0-3653b1d07e7d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caaebade-d0dd-4d4c-9ab8-0bae3b830203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caaebade-d0dd-4d4c-9ab8-0bae3b830203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11790079-c3d3-4318-9f2f-64bbb36fd6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:18 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume 376695d4-952e-4b95-bcf0-3653b1d07e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376695d4-952e-4b95-bcf0-3653b1d07e7d', 'volume_size': 1}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:18 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Volume volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d (c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d): created successfully
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bce4082-9e95-4a95-a4fe-c51f38f7e1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:18 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Flow 'volume_create_manager' (8d08f0cd-d5e2-4604-a0fd-ac4181d7a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:18 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-16345cb6-c524-462e-abb4-4e868121fac9 tempest-CreateVolumesFromImageTest-1689353103 None] Created volume successfully.
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bb3a85-c5c0-4972-944f-c8102995dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd6530f06-1228-453d-909f-8fbbee288af8', 'volume_name': 'volume-d6530f06-1228-453d-909f-8fbbee288af8', 'volume_size': 1, 'image_id': '68056d59-9038-4a00-a44a-a3f4f5819220', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68056d59-9038-4a00-a44a-a3f4f5819220', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e455e34a55824be97f7bc6f1176d93f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '351d4f2136474f61a53f74a86045f1e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3c96eb8a220ca9c00120ecae8c148b90d791c8a05480cee1c58485abce1db54cdfc41b3c0d45c189b6a905a51c8d7feb1d304477d46201a3d2de8b66c6586bf', 'id': '68056d59-9038-4a00-a44a-a3f4f5819220', 'created_at': datetime.datetime(2026, 11, 5, 17, 52, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 52, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68056d59-9038-4a00-a44a-a3f4f5819220/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea443500>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ad7841-d783-4d03-a1ba-ec502628b0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ad7841-d783-4d03-a1ba-ec502628b0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0baec574-5b28-4e8a-a26c-43c50d5f894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:19 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Volume d6530f06-1228-453d-909f-8fbbee288af8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d6530f06-1228-453d-909f-8fbbee288af8', 'volume_size': 1, 'image_id': '68056d59-9038-4a00-a44a-a3f4f5819220', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68056d59-9038-4a00-a44a-a3f4f5819220', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e455e34a55824be97f7bc6f1176d93f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '351d4f2136474f61a53f74a86045f1e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3c96eb8a220ca9c00120ecae8c148b90d791c8a05480cee1c58485abce1db54cdfc41b3c0d45c189b6a905a51c8d7feb1d304477d46201a3d2de8b66c6586bf', 'id': '68056d59-9038-4a00-a44a-a3f4f5819220', 'created_at': datetime.datetime(2026, 11, 5, 17, 52, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 52, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68056d59-9038-4a00-a44a-a3f4f5819220/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea443500>}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Trying to clone d6530f06-1228-453d-909f-8fbbee288af8 from image 68056d59-9038-4a00-a44a-a3f4f5819220 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68056d59-9038-4a00-a44a-a3f4f5819220', 'metadata': {}}]). {{(pid=87086) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 18:52:19 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a031cc-47d9-4a63-9ce0-a16e0118a7b1]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:19 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e 1073741824" returned: 0 in 0.556s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:19 devstack sudo[106187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e
Nov 05 18:52:19 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:19 devstack sudo[106186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD
Nov 05 18:52:19 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:19 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e" returned: 0 in 0.268s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.942s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1503233058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6542aaa-c0f1-4250-a8eb-095d35a7a4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79436547c65c47bc8cec08a95a91cd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:15Z,use_quota=True,user_id='8691c57c01d24568a3a7199b73fa0b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Creating volume e6542aaa-c0f1-4250-a8eb-095d35a7a4b3 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:19 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:19 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:19 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3 1073741824
Nov 05 18:52:19 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc309a97-1315-4940-9e52-5952484bdf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1334074-9667-4d7d-b022-7518fc76fdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:19 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Volume volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e (d6043a16-2a35-439d-a64b-9f6b7ee4b83e): created successfully
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1334074-9667-4d7d-b022-7518fc76fdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Flow 'volume_create_manager' (e288f979-b0ef-471f-8fb8-5e7ad073e4d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:19 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ac7435d3-25e3-44ad-8b5e-44fc29e57443 tempest-CreateVolumesFromImageTest-1689353103 None] Created volume successfully.
Nov 05 18:52:19 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD
Nov 05 18:52:19 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:19 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:52:19 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Temporary image 68056d59-9038-4a00-a44a-a3f4f5819220 is fetched for user 84caabcea8d94cef97be3781e40b57fe. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 18:52:20 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3 1073741824" returned: 0 in 0.471s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6809a72-6bae-4b5b-8883-0756aa7a5db3]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:20 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3
Nov 05 18:52:20 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:20 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD
Nov 05 18:52:20 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:20 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3" returned: 0 in 0.287s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.583s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:20 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1576492820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b98011-ac84-4f77-86a6-843994169f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5769f17a705b4b33b68c880aa0b02515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:16Z,use_quota=True,user_id='081bda12dddc4b6c93e98b837f16f559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Creating volume b2b98011-ac84-4f77-86a6-843994169f8b {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:20 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:20 devstack sudo[106210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b 1073741824
Nov 05 18:52:20 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d22af44-77ac-4861-b505-681493764221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9abde38-9fbe-418e-bcbe-a29330ce8fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:20 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Volume volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3 (e6542aaa-c0f1-4250-a8eb-095d35a7a4b3): created successfully
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9abde38-9fbe-418e-bcbe-a29330ce8fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Flow 'volume_create_manager' (0b80b657-daaf-4184-a628-387a895fdc4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:20 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-481ec179-2a84-4e4f-bc18-f085d4fe4e16 tempest-CreateVolumesFromImageTest-1689353103 None] Created volume successfully.
Nov 05 18:52:20 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD
Nov 05 18:52:20 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:20 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:20 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b 1073741824" returned: 0 in 0.445s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:20 devstack sudo[106220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b
Nov 05 18:52:20 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:21 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b" returned: 0 in 0.244s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.431s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1238995475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c740ec97-6130-4fe3-8570-8815ab31e140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:16Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Creating volume c740ec97-6130-4fe3-8570-8815ab31e140 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:21 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f5cad9-f1f9-4be7-8217-a0759c74af9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b98011-ac84-4f77-86a6-843994169f8b', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:21 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140 1073741824
Nov 05 18:52:21 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebea350-707a-4355-8f87-d7c4e60d720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:21 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Volume volume-b2b98011-ac84-4f77-86a6-843994169f8b (b2b98011-ac84-4f77-86a6-843994169f8b): created successfully
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ebea350-707a-4355-8f87-d7c4e60d720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Flow 'volume_create_manager' (616411b2-3146-4917-867f-3326179df331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c281c7c2-6363-4ddb-abc6-925d79f2d849 tempest-CinderUnicodeTest-1224633453 None] Created volume successfully.
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "cinder-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "cinder-quobyte-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-quobyte-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba7f01f-ef5c-4292-8a3a-96a0799d90ef]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:21 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3
Nov 05 18:52:21 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:21 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140 1073741824" returned: 0 in 0.535s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:21 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140
Nov 05 18:52:21 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:21 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3" returned: 0 in 0.404s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:21 devstack sudo[106236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3
Nov 05 18:52:21 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:21 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140" returned: 0 in 0.263s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.869s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-518455204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c44e90f-ec4a-4149-a3a1-518a303ad8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:17Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Creating volume 4c44e90f-ec4a-4149-a3a1-518a303ad8e0 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:21 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad69af6-9de9-4128-a560-b83d2356fb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c740ec97-6130-4fe3-8570-8815ab31e140', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:21 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0 1073741824
Nov 05 18:52:21 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d72a7f2-b0b0-4d5a-9a95-779abfba319b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:22 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume volume-c740ec97-6130-4fe3-8570-8815ab31e140 (c740ec97-6130-4fe3-8570-8815ab31e140): created successfully
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d72a7f2-b0b0-4d5a-9a95-779abfba319b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (5f451ffe-8783-494b-aa56-91b8b9866761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:22 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-32b4b9a3-7b75-4e8b-84b3-38e874f9640e tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created volume successfully.
Nov 05 18:52:22 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3" returned: 0 in 0.289s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-quobyte-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3" released by "delete_volume" :: held 0.744s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Created reservations ['31e5547b-3be4-4b07-b6cc-7fb83fcdb90b', 'aa55777d-fb73-4e01-9308-12086c68764b', '73092d37-0c68-49a6-8c9d-bfbb8e187b6d', '3986a41b-3ea3-4b16-b97a-bfde4035bc9d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:22 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:22 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "cinder-d6043a16-2a35-439d-a64b-9f6b7ee4b83e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-d6043a16-2a35-439d-a64b-9f6b7ee4b83e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:22 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0 1073741824" returned: 0 in 0.660s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:22 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "cinder-quobyte-d6043a16-2a35-439d-a64b-9f6b7ee4b83e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.347s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-quobyte-d6043a16-2a35-439d-a64b-9f6b7ee4b83e" acquired by "delete_volume" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:22 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0
Nov 05 18:52:22 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:22 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Deleted volume successfully.
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[af195c72-0bda-48a2-90e9-1a9a5e1aee4e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-dec5ea7b-b3c7-4134-a628-19ba7d5f2670 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-e6542aaa-c0f1-4250-a8eb-095d35a7a4b3-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:22 devstack sudo[106251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e
Nov 05 18:52:22 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:22 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0" returned: 0 in 0.265s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.419s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1124260834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e88a001-31aa-4fdb-ba87-5d445f8d5571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:17Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Creating volume 9e88a001-31aa-4fdb-ba87-5d445f8d5571 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:22 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640521e0-da87-47cf-9301-d43f88579fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e90fa4-d2dd-4eee-abe7-ca2cdc774cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:23 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571 1073741824
Nov 05 18:52:23 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0 (4c44e90f-ec4a-4149-a3a1-518a303ad8e0): created successfully
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e90fa4-d2dd-4eee-abe7-ca2cdc774cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (ef9b59b5-b42a-4f55-a7fb-4e6ae7420e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b518e266-03dd-4492-9bea-2d507e2335e5 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created volume successfully.
Nov 05 18:52:23 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e" returned: 0 in 0.390s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:23 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e
Nov 05 18:52:23 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:23 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6043a16-2a35-439d-a64b-9f6b7ee4b83e" returned: 0 in 0.259s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-quobyte-d6043a16-2a35-439d-a64b-9f6b7ee4b83e" released by "delete_volume" :: held 0.712s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:23 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571 1073741824" returned: 0 in 0.462s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Created reservations ['f466ad48-3ead-449e-8bd0-842654b32422', '53fc9c21-6427-49f4-b5f4-9a88af357ea9', '242e3895-10e7-479b-9761-31ba88328848', 'd5164a39-75e8-4d87-a135-4de9f0367390'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:23 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571
Nov 05 18:52:23 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:23 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:23 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:23 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571" returned: 0 in 0.262s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.226s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894437104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52775e15-e04b-4609-94e6-c9feae862523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:18Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Creating volume 52775e15-e04b-4609-94e6-c9feae862523 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:23 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "cinder-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:23 devstack sudo[106271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523 1073741824
Nov 05 18:52:23 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62eb1c01-03c4-4b3e-afe9-1acf96506296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9986e8-7869-456b-8e71-8d292eed7603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571 (9e88a001-31aa-4fdb-ba87-5d445f8d5571): created successfully
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9986e8-7869-456b-8e71-8d292eed7603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (728b0c9c-7699-42e5-acec-3a3fc491e2fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:23 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "cinder-quobyte-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-84fbc757-8561-4bce-9192-b5b8cbd6a3c0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created volume successfully.
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.395s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:23 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Deleted volume successfully.
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-quobyte-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d" acquired by "delete_volume" :: waited 0.038s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-ba685490-4bad-4ced-95cc-7d8298cbf78d tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-d6043a16-2a35-439d-a64b-9f6b7ee4b83e-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e451217-006e-454c-a128-72e2c18fe784]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:24 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d
Nov 05 18:52:24 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:24 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523 1073741824" returned: 0 in 0.576s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:24 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523
Nov 05 18:52:24 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:24 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d" returned: 0 in 0.408s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:24 devstack sudo[106285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d
Nov 05 18:52:24 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:24 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523" returned: 0 in 0.279s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.903s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-968132659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376695d4-952e-4b95-bcf0-3653b1d07e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af74bdb605e142f5994f26c320cdca50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:19Z,use_quota=True,user_id='e53a560e2d954a9b87f41ca55667873f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Creating volume 376695d4-952e-4b95-bcf0-3653b1d07e7d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:24 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:24 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fb4fb4-dc26-4a2a-b58a-d16a1fd3a0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52775e15-e04b-4609-94e6-c9feae862523', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:24 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d 1073741824
Nov 05 18:52:24 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9224137-f568-4948-95c7-5a3d86ed6111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d" returned: 0 in 0.283s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-quobyte-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d" released by "delete_volume" :: held 0.752s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:24 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume volume-52775e15-e04b-4609-94e6-c9feae862523 (52775e15-e04b-4609-94e6-c9feae862523): created successfully
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9224137-f568-4948-95c7-5a3d86ed6111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (5449c7cd-9070-48fe-903e-c4222892a6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-70528167-0588-4a17-9bfb-a4f2527688ee tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created volume successfully.
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Created reservations ['c7531409-163a-4f9d-8646-2f0c29969536', '4c0471c8-64a9-48b0-9745-b4b082c400cc', 'acdbea68-00c2-42e5-bbfa-9fa7f77a0d6e', '15dd8537-4a93-49fe-9d0b-efefcd958c60'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:24 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:24 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "cinder-c1666daa-d260-4c66-9ab0-fe98690dbc8e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-c1666daa-d260-4c66-9ab0-fe98690dbc8e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "cinder-quobyte-c1666daa-d260-4c66-9ab0-fe98690dbc8e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-quobyte-c1666daa-d260-4c66-9ab0-fe98690dbc8e" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c44a67-b39c-44fc-88ac-2dbbd0e210f6]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:25 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.328s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:25 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Deleted volume successfully.
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b7214bbc-1a43-4608-b830-76884e6c6773 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-c94b2dfc-ab3e-4d7f-a583-3db5a3646f7d-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:25 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d 1073741824" returned: 0 in 0.663s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:25 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e
Nov 05 18:52:25 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:25 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d
Nov 05 18:52:25 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:25 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:25 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:25 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e" returned: 0 in 0.428s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:25 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e
Nov 05 18:52:25 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:25 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d" returned: 0 in 0.305s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.977s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6530f06-1228-453d-909f-8fbbee288af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351d4f2136474f61a53f74a86045f1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:18Z,use_quota=True,user_id='84caabcea8d94cef97be3781e40b57fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fe2ab31-18ed-4a35-913e-9d4292cf3117),volume_type_id=8fe2ab31-18ed-4a35-913e-9d4292cf3117)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Creating volume d6530f06-1228-453d-909f-8fbbee288af8 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:25 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11790079-c3d3-4318-9f2f-64bbb36fd6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376695d4-952e-4b95-bcf0-3653b1d07e7d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:25 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 1073741824
Nov 05 18:52:25 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f898719-cfc6-4a91-adca-c23da64ed22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:25 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Volume volume-376695d4-952e-4b95-bcf0-3653b1d07e7d (376695d4-952e-4b95-bcf0-3653b1d07e7d): created successfully
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f898719-cfc6-4a91-adca-c23da64ed22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Flow 'volume_create_manager' (467344d8-53e0-4114-ae66-568dd642ac9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:25 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b5e47f1a-2680-41ba-93c5-9ac1be003e22 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created volume successfully.
Nov 05 18:52:25 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.335s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:25 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c1666daa-d260-4c66-9ab0-fe98690dbc8e" returned: 0 in 0.265s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:52:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-quobyte-c1666daa-d260-4c66-9ab0-fe98690dbc8e" released by "delete_volume" :: held 0.752s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Created reservations ['4f90a5f9-712c-484e-b0b2-0b469215ef15', '74db52fa-27ce-4700-a853-74a760f68ed0', '4a6a6926-0708-442e-b898-82f5ae6a9cb0', '6f8eb22b-dfb9-4cdb-b5b8-4d8d8cf31353'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:26 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:26 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-376695d4-952e-4b95-bcf0-3653b1d07e7d-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "cinder-d8716358-3138-46cf-ae86-aea3a38a1635-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:26 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 1073741824" returned: 0 in 0.605s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-376695d4-952e-4b95-bcf0-3653b1d07e7d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-d8716358-3138-46cf-ae86-aea3a38a1635-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "cinder-quobyte-d8716358-3138-46cf-ae86-aea3a38a1635" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:26 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-quobyte-376695d4-952e-4b95-bcf0-3653b1d07e7d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-quobyte-d8716358-3138-46cf-ae86-aea3a38a1635" acquired by "delete_volume" :: waited 0.040s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:26 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8
Nov 05 18:52:26 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.369s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Deleted volume successfully.
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-376695d4-952e-4b95-bcf0-3653b1d07e7d" acquired by "delete_volume" :: waited 0.047s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[59df0942-9dc6-4d10-8120-19336892304e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b593f0-e029-48b1-b1d5-25723ae8ad7a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3274050d-9349-41ce-b258-1ebd607c0f31 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-c1666daa-d260-4c66-9ab0-fe98690dbc8e-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:26 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d
Nov 05 18:52:26 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:26 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635
Nov 05 18:52:26 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:26 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.183s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Creating offline snapshot 2d8429dc-c63f-4b34-b409-9f99cd7bac91 of volume b2b98011-ac84-4f77-86a6-843994169f8b {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f22a37-82f6-4372-a092-12a37626c37f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Attempting download of 68056d59-9038-4a00-a44a-a3f4f5819220 ((None, [{'url': 'file:///opt/stack/data/glance/images/68056d59-9038-4a00-a44a-a3f4f5819220', 'metadata': {}}])) to volume d6530f06-1228-453d-909f-8fbbee288af8. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d97567-f98b-409e-afd4-8b87efa72178]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68056d59-9038-4a00-a44a-a3f4f5819220_xfoujaya {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:26 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b
Nov 05 18:52:26 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:26 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635" returned: 0 in 0.414s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:26 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d" returned: 0 in 0.410s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:26 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635
Nov 05 18:52:26 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:26 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68056d59-9038-4a00-a44a-a3f4f5819220_xfoujaya
Nov 05 18:52:26 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:26 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d
Nov 05 18:52:26 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:27 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b" returned: 0 in 0.392s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:27 devstack sudo[106348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91 1G
Nov 05 18:52:27 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:27 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68056d59-9038-4a00-a44a-a3f4f5819220_xfoujaya" returned: 0 in 0.353s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68056d59-9038-4a00-a44a-a3f4f5819220_xfoujaya {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:27 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d8716358-3138-46cf-ae86-aea3a38a1635" returned: 0 in 0.297s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-quobyte-d8716358-3138-46cf-ae86-aea3a38a1635" released by "delete_volume" :: held 0.794s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:27 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-376695d4-952e-4b95-bcf0-3653b1d07e7d" returned: 0 in 0.311s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-376695d4-952e-4b95-bcf0-3653b1d07e7d" released by "delete_volume" :: held 0.776s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:27 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68056d59-9038-4a00-a44a-a3f4f5819220_xfoujaya
Nov 05 18:52:27 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Created reservations ['51ab7e9f-e3d9-4f82-9521-61af658b54a9', '7e5c9328-d12d-4a30-a8c4-85de31b373d3', '49f4e688-a560-4e5f-b131-c52c1e72924d', 'd9faf83c-3601-419e-9410-2d7e8d0997a6'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created reservations ['f3ae2e7e-e159-4e59-a37e-091c76159294', '82e25387-f83d-4cbd-99b1-8f084a0d25bf', 'faa0877b-4b89-478c-aef9-d9797e373e97', '8b0becc7-a8e5-41d6-9318-b5613f0c3722'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:27 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:27 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-52775e15-e04b-4609-94e6-c9feae862523-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-52775e15-e04b-4609-94e6-c9feae862523-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:27 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68056d59-9038-4a00-a44a-a3f4f5819220_xfoujaya" returned: 1 in 0.436s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68056d59-9038-4a00-a44a-a3f4f5819220_xfoujaya' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[381873f1-6b0e-40be-9cb0-c83dc43fcb97]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:27 devstack sudo[106361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:27 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-quobyte-52775e15-e04b-4609-94e6-c9feae862523" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-52775e15-e04b-4609-94e6-c9feae862523" acquired by "delete_volume" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1776f7-106e-43c3-9c38-5612be753ab2]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:27 devstack sudo[106362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD
Nov 05 18:52:27 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:27 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91 1G" returned: 0 in 0.694s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b98011-ac84-4f77-86a6-843994169f8b -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:27 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.403s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:27 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Deleted volume successfully.
Nov 05 18:52:27 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b98011-ac84-4f77-86a6-843994169f8b -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91
Nov 05 18:52:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3439e4e5-bc54-4c0e-acb4-10121fd3a182 tempest-CreateVolumesFromImageTest-1689353103 None] Lock "cinder-d8716358-3138-46cf-ae86-aea3a38a1635-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:27 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:27 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523
Nov 05 18:52:27 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:28 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.461s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:28 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Deleted volume successfully.
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1313857c-6909-487c-8c8c-c325958580a0 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-376695d4-952e-4b95-bcf0-3653b1d07e7d-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:28 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD" returned: 0 in 0.526s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:28 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523" returned: 0 in 0.477s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:28 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2b98011-ac84-4f77-86a6-843994169f8b -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:28 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91 is being set with open permissions: ugo+rw
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:28 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523
Nov 05 18:52:28 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:28 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91
Nov 05 18:52:28 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:28 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD
Nov 05 18:52:28 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:28 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91" returned: 0 in 0.270s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:28 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-52775e15-e04b-4609-94e6-c9feae862523" returned: 0 in 0.331s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-52775e15-e04b-4609-94e6-c9feae862523" released by "delete_volume" :: held 0.878s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:28 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD" returned: 1 in 0.506s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] 68056d59-9038-4a00-a44a-a3f4f5819220 was raw, converting to qcow2 {{(pid=87086) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:28 devstack sudo[106390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.info
Nov 05 18:52:28 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:28 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8
Nov 05 18:52:28 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created reservations ['66ca6925-c3de-4f2b-b42d-6f6f13f74f14', 'a14d505b-c299-4663-bafe-b5e54525d971', 'a460099a-8ede-4d3c-a28f-759df1a364af', '9c283c8f-83ba-4f87-bce3-095cd63d0081'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:28 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:28 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:29 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.info" returned: 0 in 0.422s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:29 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.info is being set with open permissions: ugo+rw
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:29 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.info
Nov 05 18:52:29 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:29 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.369s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Deleted volume successfully.
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9d9a5634-b953-4bfe-81bb-13c871a680b1 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-52775e15-e04b-4609-94e6-c9feae862523-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:29 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.info" returned: 0 in 0.301s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:29 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.710s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8" returned: 0 in 0.732s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68056d59-9038-4a00-a44a-a3f4f5819220_81xnezf9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:52:29 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:29 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 1G
Nov 05 18:52:29 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-50db5335-c951-49ca-8502-354c8f4b9739 tempest-CinderUnicodeTest-1224633453 None] Create snapshot completed successfully
Nov 05 18:52:29 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 1G" returned: 0 in 0.377s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Downloaded image 68056d59-9038-4a00-a44a-a3f4f5819220 ((None, [{'url': 'file:///opt/stack/data/glance/images/68056d59-9038-4a00-a44a-a3f4f5819220', 'metadata': {}}])) to volume d6530f06-1228-453d-909f-8fbbee288af8 successfully. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Temporary image 68056d59-9038-4a00-a44a-a3f4f5819220 for user 84caabcea8d94cef97be3781e40b57fe is deleted. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Marking volume d6530f06-1228-453d-909f-8fbbee288af8 as bootable. {{(pid=87086) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Copying metadata from image 68056d59-9038-4a00-a44a-a3f4f5819220 to d6530f06-1228-453d-909f-8fbbee288af8. {{(pid=87086) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Creating volume glance metadata for volume d6530f06-1228-453d-909f-8fbbee288af8 backed by image 68056d59-9038-4a00-a44a-a3f4f5819220 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '68056d59-9038-4a00-a44a-a3f4f5819220', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1e455e34a55824be97f7bc6f1176d93f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87086) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-9e88a001-31aa-4fdb-ba87-5d445f8d5571-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "cinder-2d8429dc-c63f-4b34-b409-9f99cd7bac91-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0baec574-5b28-4e8a-a26c-43c50d5f894c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6530f06-1228-453d-909f-8fbbee288af8', 'volume_size': 1, 'image_id': '68056d59-9038-4a00-a44a-a3f4f5819220', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68056d59-9038-4a00-a44a-a3f4f5819220', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1e455e34a55824be97f7bc6f1176d93f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '351d4f2136474f61a53f74a86045f1e1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a3c96eb8a220ca9c00120ecae8c148b90d791c8a05480cee1c58485abce1db54cdfc41b3c0d45c189b6a905a51c8d7feb1d304477d46201a3d2de8b66c6586bf', 'id': '68056d59-9038-4a00-a44a-a3f4f5819220', 'created_at': datetime.datetime(2026, 11, 5, 17, 52, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 52, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68056d59-9038-4a00-a44a-a3f4f5819220/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcea443500>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3e64cc-78bd-49f3-b802-b83fab793529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-9e88a001-31aa-4fdb-ba87-5d445f8d5571-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-2d8429dc-c63f-4b34-b409-9f99cd7bac91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "cinder-quobyte-b2b98011-ac84-4f77-86a6-843994169f8b" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:30 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Volume volume-d6530f06-1228-453d-909f-8fbbee288af8 (d6530f06-1228-453d-909f-8fbbee288af8): created successfully
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3e64cc-78bd-49f3-b802-b83fab793529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Flow 'volume_create_manager' (ca62501a-ed39-464c-9437-94872f66f903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:30 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1d9b064f-0209-4d6f-bb3f-09a758437daf tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Created volume successfully.
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-quobyte-b2b98011-ac84-4f77-86a6-843994169f8b" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "cinder-quobyte-2d8429dc-c63f-4b34-b409-9f99cd7bac91" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-quobyte-9e88a001-31aa-4fdb-ba87-5d445f8d5571" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-quobyte-2d8429dc-c63f-4b34-b409-9f99cd7bac91" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Deleting offline snapshot 2d8429dc-c63f-4b34-b409-9f99cd7bac91 of volume b2b98011-ac84-4f77-86a6-843994169f8b {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] snapshot_file for this snap is: volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-9e88a001-31aa-4fdb-ba87-5d445f8d5571" acquired by "delete_volume" :: waited 0.047s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d2d573-41bd-447e-ab8c-144f45bf94ad]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea9cb90-00b6-499d-b66e-cfdfce2682d9]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:30 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571
Nov 05 18:52:30 devstack sudo[106410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91
Nov 05 18:52:30 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:30 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:30 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571" returned: 0 in 0.430s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:30 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91" returned: 0 in 0.476s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2b98011-ac84-4f77-86a6-843994169f8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:52:30 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571
Nov 05 18:52:30 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b47146-0143-41e7-809b-de061069181f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:30 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b
Nov 05 18:52:30 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:30 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9e88a001-31aa-4fdb-ba87-5d445f8d5571" returned: 0 in 0.322s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-9e88a001-31aa-4fdb-ba87-5d445f8d5571" released by "delete_volume" :: held 0.819s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Acquiring lock "cinder-d6530f06-1228-453d-909f-8fbbee288af8-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Lock "cinder-d6530f06-1228-453d-909f-8fbbee288af8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Acquiring lock "cinder-quobyte-d6530f06-1228-453d-909f-8fbbee288af8" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created reservations ['aec91e52-6f49-4652-886c-84c5699de1e7', 'f2000534-42b4-48d5-be45-38f17227c5a4', '14a69662-5e64-4db6-ba31-6cf602374b18', '52162c28-bc2b-4129-92ab-77b735ed9794'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:31 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b" returned: 0 in 0.480s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Lock "cinder-quobyte-d6530f06-1228-453d-909f-8fbbee288af8" acquired by "delete_volume" :: waited 0.057s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:31 devstack sudo[106428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91
Nov 05 18:52:31 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08f44c0-de7d-4404-9694-dcf29c3f71a4]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:31 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:31 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:31 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8
Nov 05 18:52:31 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (0794cc1b-d077-4314-828f-e841d15c0c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:31 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae87b1bd-362b-436a-b1a1-408c52c1ef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91" returned: 0 in 0.434s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:31 devstack sudo[106438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91
Nov 05 18:52:31 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae87b1bd-362b-436a-b1a1-408c52c1ef29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1103717786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd5a659-e10a-4c96-806f-58c2d2ba673d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:31Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a12dfc9-32e9-4d17-9ff4-1d06f6720e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a12dfc9-32e9-4d17-9ff4-1d06f6720e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74504dd-87b6-4aa1-a90d-f304f3ea3b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74504dd-87b6-4aa1-a90d-f304f3ea3b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd5a659-e10a-4c96-806f-58c2d2ba673d', 'volume_name': 'volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d594a337-50a9-440d-9d47-ca4d2a677e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d594a337-50a9-440d-9d47-ca4d2a677e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9aa6d3-33b6-42fd-9dff-0d33e63ac86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:31 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume fbd5a659-e10a-4c96-806f-58c2d2ba673d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d', 'volume_size': 1}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1103717786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd5a659-e10a-4c96-806f-58c2d2ba673d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:31Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Creating volume fbd5a659-e10a-4c96-806f-58c2d2ba673d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:31 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:31 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.350s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:31 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d 1073741824
Nov 05 18:52:31 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:31 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Deleted volume successfully.
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-364d7894-f528-482b-a7fd-af5de1300a08 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-9e88a001-31aa-4fdb-ba87-5d445f8d5571-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:31 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8" returned: 0 in 0.526s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:31 devstack sudo[106446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8
Nov 05 18:52:31 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:31 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b.2d8429dc-c63f-4b34-b409-9f99cd7bac91" returned: 0 in 0.304s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-quobyte-2d8429dc-c63f-4b34-b409-9f99cd7bac91" released by "_delete_snapshot" :: held 1.850s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:31 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-quobyte-b2b98011-ac84-4f77-86a6-843994169f8b" released by "delete_snapshot" :: held 1.888s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Created reservations ['22bae30a-b734-480a-8ac3-7072daa05e26', 'dfcd9f74-a2c6-4a53-9069-e6680cc5e5bb', '01d9c79a-6846-47f1-a51e-b515e80db5d2', '57c19e3f-faf8-467d-84cd-d8b6fe583eb0'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:32 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d6530f06-1228-453d-909f-8fbbee288af8" returned: 0 in 0.286s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Lock "cinder-quobyte-d6530f06-1228-453d-909f-8fbbee288af8" released by "delete_volume" :: held 0.901s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Delete snapshot completed successfully.
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-81f97976-bd6c-4145-8d37-013a1a19a414 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-2d8429dc-c63f-4b34-b409-9f99cd7bac91-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Created reservations ['7bbd67a3-61af-40c0-a8fc-315c1172d83e', '3e67e29a-2b83-4c63-b4e2-b24deb21f552', 'c272b9b3-ad2b-4e99-961c-8d04cc772bab', 'bf58efa0-a920-4947-80d0-77da9836ed7e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "cinder-b2b98011-ac84-4f77-86a6-843994169f8b-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-b2b98011-ac84-4f77-86a6-843994169f8b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:32 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-4c44e90f-ec4a-4149-a3a1-518a303ad8e0-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "cinder-quobyte-b2b98011-ac84-4f77-86a6-843994169f8b" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d 1073741824" returned: 0 in 0.635s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-4c44e90f-ec4a-4149-a3a1-518a303ad8e0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-quobyte-b2b98011-ac84-4f77-86a6-843994169f8b" acquired by "delete_volume" :: waited 0.044s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd90a5f-dcd1-4686-b351-2866fd2e806a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:32 devstack sudo[106454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:32 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-quobyte-4c44e90f-ec4a-4149-a3a1-518a303ad8e0" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-4c44e90f-ec4a-4149-a3a1-518a303ad8e0" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:32 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d
Nov 05 18:52:32 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f1397a-b7a9-47fd-a763-c9cef840e86f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:32 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b
Nov 05 18:52:32 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:32 devstack sudo[106459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0
Nov 05 18:52:32 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:32 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.288s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Deleted volume successfully.
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ccaf2c0-68ad-4316-837b-39d53f50e5ec tempest-VolumeAndVolumeTypeFromImageTest-461942856 None] Lock "cinder-d6530f06-1228-453d-909f-8fbbee288af8-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:32 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d" returned: 0 in 0.348s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9aa6d3-33b6-42fd-9dff-0d33e63ac86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d630353-56b2-4809-83c1-eceed94c35d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:32 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d (fbd5a659-e10a-4c96-806f-58c2d2ba673d): created successfully
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d630353-56b2-4809-83c1-eceed94c35d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (0794cc1b-d077-4314-828f-e841d15c0c06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6968dc43-bf93-4a5d-ab35-bb490c9d48b3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Created volume successfully.
Nov 05 18:52:32 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b" returned: 0 in 0.444s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:32 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b
Nov 05 18:52:32 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:32 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0" returned: 0 in 0.443s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:32 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0
Nov 05 18:52:32 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:33 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b2b98011-ac84-4f77-86a6-843994169f8b" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-quobyte-b2b98011-ac84-4f77-86a6-843994169f8b" released by "delete_volume" :: held 0.825s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Created reservations ['43427bb0-d2fd-4a64-aecb-41187e049f30', '3de749bd-9cb5-44e2-bd46-7eefcc1d3f12', 'a1bebed3-60ca-48d7-8e7f-7425f252f01d', 'd1abfc0d-dcd4-420a-a179-e17cb235fe4d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:33 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-4c44e90f-ec4a-4149-a3a1-518a303ad8e0" returned: 0 in 0.264s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-4c44e90f-ec4a-4149-a3a1-518a303ad8e0" released by "delete_volume" :: held 0.789s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created reservations ['0ee161e9-f800-4a78-a9c2-e71c4f439acd', 'cdcd3ee4-e788-419f-b054-d9f99033a211', 'b87d963f-4fc5-4daf-b528-c8e919fc5220', '46725e67-9a7c-4c81-a755-15e4ebeae8ea'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:33 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:33 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "cinder-43edb71b-96f1-4c3d-ae00-d7bc57081864-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-43edb71b-96f1-4c3d-ae00-d7bc57081864-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "cinder-quobyte-43edb71b-96f1-4c3d-ae00-d7bc57081864" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-quobyte-43edb71b-96f1-4c3d-ae00-d7bc57081864" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:33 devstack sudo[106479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:33 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b8decd-7784-4cc7-840f-bf380c426a5b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:33 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.444s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Deleted volume successfully.
Nov 05 18:52:33 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864
Nov 05 18:52:33 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-381fd2e7-5b10-439d-9c7a-ee1e42a5ac21 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-b2b98011-ac84-4f77-86a6-843994169f8b-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:33 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.435s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Creating offline snapshot 4fae40d7-fd92-48f9-8be1-187c2d011f6c of volume fbd5a659-e10a-4c96-806f-58c2d2ba673d {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:52:33 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Deleted volume successfully.
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[023479ae-8b0e-4170-802f-1bc785ba494e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d87103d5-2518-4c49-aea7-4c504db262cd tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-4c44e90f-ec4a-4149-a3a1-518a303ad8e0-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:34 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d
Nov 05 18:52:34 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:34 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864" returned: 0 in 0.521s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:34 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864
Nov 05 18:52:34 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:34 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:34 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d" returned: 0 in 0.457s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-43edb71b-96f1-4c3d-ae00-d7bc57081864" returned: 0 in 0.306s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:34 devstack sudo[106498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c 1G
Nov 05 18:52:34 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-quobyte-43edb71b-96f1-4c3d-ae00-d7bc57081864" released by "delete_volume" :: held 0.904s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Created reservations ['d7cc1b80-9114-40b2-bd8f-1dc2234e72ae', 'dfb82c96-3c29-4efc-a9bb-c3e0b6abdca7', '43264635-7082-4253-a567-2ed331a5564b', '3ae2d44d-b537-4c20-aa76-a3d605aab589'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-c740ec97-6130-4fe3-8570-8815ab31e140-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-c740ec97-6130-4fe3-8570-8815ab31e140-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-quobyte-c740ec97-6130-4fe3-8570-8815ab31e140" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-c740ec97-6130-4fe3-8570-8815ab31e140" acquired by "delete_volume" :: waited 0.042s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:34 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:34 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8804c838-b099-476e-9873-dc27cabf745a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:34 devstack sudo[106506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140
Nov 05 18:52:34 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:35 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c 1G" returned: 0 in 0.573s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:35 devstack sudo[106509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c
Nov 05 18:52:35 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:35 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.355s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:35 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Deleted volume successfully.
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c7e7e571-7be4-4447-a2fd-cfd2c4692219 tempest-CinderUnicodeTest-1224633453 None] Lock "cinder-43edb71b-96f1-4c3d-ae00-d7bc57081864-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:35 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140" returned: 0 in 0.589s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:35 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140
Nov 05 18:52:35 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:35 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c" returned: 0 in 0.504s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:35 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c is being set with open permissions: ugo+rw
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:35 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c
Nov 05 18:52:35 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:35 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c740ec97-6130-4fe3-8570-8815ab31e140" returned: 0 in 0.405s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-c740ec97-6130-4fe3-8570-8815ab31e140" released by "delete_volume" :: held 1.059s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:35 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c" returned: 0 in 0.370s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created reservations ['45106b89-cbaf-4e9d-9f8f-fd7f77a01fd8', 'ef205525-730f-4c68-92a5-fdc229fb5d4c', '611659a3-13c0-478f-bded-bb0841e8bf41', '58d7504f-21df-4e40-868e-580eb534e663'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:36 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.info
Nov 05 18:52:36 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:36 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:36 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:36 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.info" returned: 0 in 0.360s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:36 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.info is being set with open permissions: ugo+rw
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:36 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.info
Nov 05 18:52:36 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:36 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.331s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Deleted volume successfully.
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7ad85fc0-241a-4212-88d3-c0aba6497fc7 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-c740ec97-6130-4fe3-8570-8815ab31e140-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:36 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.info" returned: 0 in 0.339s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:36 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-33ee95d9-d0c5-4cce-b61d-460d8a161d43 tempest-CreateVolumesFromSnapshotTest-844119863 None] Create snapshot completed successfully
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-e0189062-8484-46f5-8b21-00f22609384a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-e0189062-8484-46f5-8b21-00f22609384a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "cinder-quobyte-e0189062-8484-46f5-8b21-00f22609384a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-e0189062-8484-46f5-8b21-00f22609384a" acquired by "delete_volume" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d86b40-f40d-4839-8cc0-bab57c5b48a1]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:37 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a
Nov 05 18:52:37 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:37 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a" returned: 0 in 0.540s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:37 devstack sudo[106544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a
Nov 05 18:52:37 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:37 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (a27b6e78-496f-40fc-b478-f43458fd20cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebc31da-fe64-421d-b0d5-24b1958d9498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-e0189062-8484-46f5-8b21-00f22609384a" returned: 0 in 0.313s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-quobyte-e0189062-8484-46f5-8b21-00f22609384a" released by "delete_volume" :: held 0.934s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:37 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ebc31da-fe64-421d-b0d5-24b1958d9498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131022230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:38Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7a22e8-bcd8-4c44-b56c-9e2814185c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7a22e8-bcd8-4c44-b56c-9e2814185c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b9d087-0b35-4ede-80e5-f715d898a4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b9d087-0b35-4ede-80e5-f715d898a4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3', 'volume_name': 'volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282bfc88-cbb1-4126-944e-18b6a6d7954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282bfc88-cbb1-4126-944e-18b6a6d7954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb559dc-e871-4089-aa64-a3d433ea00aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:38 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume 5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3', 'volume_size': 1}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2131022230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:38Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Creating volume 5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:38 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:38 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3 1073741824
Nov 05 18:52:38 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Created reservations ['558c17b0-6036-4ac7-832f-e4e26c12d488', '3f89eef8-85b8-467b-aef5-837b84fda506', 'e378c94d-7af5-4490-95c3-3b6043ee9204', 'ce1fce63-cfb7-4c4f-b9a2-01f4d3b6fd70'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:38 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:38 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (1830d942-d5b8-4c1a-9c36-86a901878410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c6b1b7-e8b9-4a83-8713-2e7c3c1d9b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:38 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.445s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c6b1b7-e8b9-4a83-8713-2e7c3c1d9b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293588057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7409f6-27c8-4cd1-a711-a4b0217f5f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:39Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a2c1b1-2049-44a5-83b6-d04f22e8bc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a2c1b1-2049-44a5-83b6-d04f22e8bc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74202cf-0529-4114-b67a-2aa5261a70e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74202cf-0529-4114-b67a-2aa5261a70e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7409f6-27c8-4cd1-a711-a4b0217f5f1d', 'volume_name': 'volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef162ac-e9ae-4843-af2c-84cea18386f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef162ac-e9ae-4843-af2c-84cea18386f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d23ccfa-1096-4019-8695-9acfc8d976bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:38 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume 2b7409f6-27c8-4cd1-a711-a4b0217f5f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d', 'volume_size': 1}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:38 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Deleted volume successfully.
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-3576f41e-a498-43d1-a9d5-1a1e78df5d83 tempest-CreateVolumesFromSourceVolumeTest-361589473 None] Lock "cinder-e0189062-8484-46f5-8b21-00f22609384a-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:38 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3 1073741824" returned: 0 in 0.804s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:38 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3
Nov 05 18:52:38 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:39 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3" returned: 0 in 0.329s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293588057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7409f6-27c8-4cd1-a711-a4b0217f5f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:39Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Creating volume 2b7409f6-27c8-4cd1-a711-a4b0217f5f1d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:39 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb559dc-e871-4089-aa64-a3d433ea00aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09f2b9d-7f3d-4b38-aebd-84b4c4242a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:39 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d 1073741824
Nov 05 18:52:39 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:39 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3 (5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3): created successfully
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09f2b9d-7f3d-4b38-aebd-84b4c4242a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (a27b6e78-496f-40fc-b478-f43458fd20cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a9a4030c-ab5e-4de5-affe-029fb5408cd9 tempest-CreateVolumesFromSnapshotTest-844119863 None] Created volume successfully.
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (f33d6e81-d34c-4c37-b87e-df5be932d537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1710b8e1-9f66-4051-b241-a2b9d404b905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1710b8e1-9f66-4051-b241-a2b9d404b905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145218937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924eef6e-29f7-4013-9aff-465800deaccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:39Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69678ed-88c1-4e18-877b-63e73761e599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69678ed-88c1-4e18-877b-63e73761e599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae70d63-121a-4543-a73f-599d0f559dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae70d63-121a-4543-a73f-599d0f559dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924eef6e-29f7-4013-9aff-465800deaccc', 'volume_name': 'volume-924eef6e-29f7-4013-9aff-465800deaccc', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3158b42-ecc1-43bf-a294-3c0b190c611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3158b42-ecc1-43bf-a294-3c0b190c611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a39865-726f-4273-96bb-97880d72ad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:39 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume 924eef6e-29f7-4013-9aff-465800deaccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924eef6e-29f7-4013-9aff-465800deaccc', 'volume_size': 1}
Nov 05 18:52:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (51e2573c-aed8-468f-a1d6-8b60ecc34e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ca47dd-1ccb-4e99-9e01-5eedab45afff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ca47dd-1ccb-4e99-9e01-5eedab45afff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482121344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317d4595-6733-4bbf-b5fd-06b6c0ba5cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:40Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff3db03-779c-4022-8578-da0762777940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff3db03-779c-4022-8578-da0762777940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50085166-4451-4ba3-8a53-a08592296050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50085166-4451-4ba3-8a53-a08592296050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317d4595-6733-4bbf-b5fd-06b6c0ba5cb8', 'volume_name': 'volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54827f62-bd1c-4e54-b4d8-5fbacf9af0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54827f62-bd1c-4e54-b4d8-5fbacf9af0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da49813-609f-460f-992f-49558580715f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume 317d4595-6733-4bbf-b5fd-06b6c0ba5cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8', 'volume_size': 1}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:40 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d 1073741824" returned: 0 in 0.933s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:40 devstack sudo[106564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d
Nov 05 18:52:40 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:40 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (e9444468-e340-4f51-ac85-f6f0f587da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd3c4b9-2052-4e3b-8e69-ad28bf2f55a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d" returned: 0 in 0.438s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.153s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1145218937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924eef6e-29f7-4013-9aff-465800deaccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:39Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Creating volume 924eef6e-29f7-4013-9aff-465800deaccc {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:40 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd3c4b9-2052-4e3b-8e69-ad28bf2f55a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1996261700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa5090b-bab0-452e-b585-5a97c13be429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:41Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:40 devstack sudo[106567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc 1073741824
Nov 05 18:52:40 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abd55b9-6f83-4f2e-aa1a-44594a36cd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abd55b9-6f83-4f2e-aa1a-44594a36cd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e658ced0-8db3-458c-8210-d656a69c8d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e658ced0-8db3-458c-8210-d656a69c8d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa5090b-bab0-452e-b585-5a97c13be429', 'volume_name': 'volume-3aa5090b-bab0-452e-b585-5a97c13be429', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599c5103-7c1f-4647-897b-952d1a275482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599c5103-7c1f-4647-897b-952d1a275482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6472d64a-5498-4422-b6e3-073c2f57927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume 3aa5090b-bab0-452e-b585-5a97c13be429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa5090b-bab0-452e-b585-5a97c13be429', 'volume_size': 1}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d23ccfa-1096-4019-8695-9acfc8d976bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9603afb-feb1-4d5f-98ad-b07bc6507488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:40 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d (2b7409f6-27c8-4cd1-a711-a4b0217f5f1d): created successfully
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9603afb-feb1-4d5f-98ad-b07bc6507488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (1830d942-d5b8-4c1a-9c36-86a901878410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:40 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8facbcc9-9d6f-4364-8c65-3ab27c5e0a41 tempest-CreateVolumesFromSnapshotTest-844119863 None] Created volume successfully.
Nov 05 18:52:41 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc 1073741824" returned: 0 in 0.711s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:41 devstack sudo[106573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc
Nov 05 18:52:41 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b2c6e350-d00a-4d0c-b745-fdb9e8607dbd tempest-ProjectAdminTests-1011961855 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.441806793213, 'free_capacity_gb': 1773.441806793213, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87086) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 18:52:41 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.809s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-482121344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317d4595-6733-4bbf-b5fd-06b6c0ba5cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:40Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Creating volume 317d4595-6733-4bbf-b5fd-06b6c0ba5cb8 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:41 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a39865-726f-4273-96bb-97880d72ad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924eef6e-29f7-4013-9aff-465800deaccc', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:41 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbae06f-0d6d-44cc-99a3-f0de20b0f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:41 devstack sudo[106576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8 1073741824
Nov 05 18:52:41 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:42 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume volume-924eef6e-29f7-4013-9aff-465800deaccc (924eef6e-29f7-4013-9aff-465800deaccc): created successfully
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbae06f-0d6d-44cc-99a3-f0de20b0f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (f33d6e81-d34c-4c37-b87e-df5be932d537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:42 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-dc4e2c51-d4ea-442d-a6b2-78bf1363fcfd tempest-CreateVolumesFromSnapshotTest-844119863 None] Created volume successfully.
Nov 05 18:52:42 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8 1073741824" returned: 0 in 0.547s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:42 devstack sudo[106581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8
Nov 05 18:52:42 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:42 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8" returned: 0 in 0.272s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.905s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1996261700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa5090b-bab0-452e-b585-5a97c13be429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47256bb684554ca7b4a21f61210f7ca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:41Z,use_quota=True,user_id='cbc30b1558bd4e949d97c818509d068a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Creating volume 3aa5090b-bab0-452e-b585-5a97c13be429 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:42 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da49813-609f-460f-992f-49558580715f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4ba959-d049-4ad2-9975-d771aab35b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:42 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429 1073741824
Nov 05 18:52:42 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:42 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8 (317d4595-6733-4bbf-b5fd-06b6c0ba5cb8): created successfully
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4ba959-d049-4ad2-9975-d771aab35b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (51e2573c-aed8-468f-a1d6-8b60ecc34e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:42 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5943403a-ffb4-4b6d-b470-f83abacebdb7 tempest-CreateVolumesFromSnapshotTest-844119863 None] Created volume successfully.
Nov 05 18:52:43 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429 1073741824" returned: 0 in 0.696s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:43 devstack sudo[106589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429
Nov 05 18:52:43 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:43 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429" returned: 0 in 0.285s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6472d64a-5498-4422-b6e3-073c2f57927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa5090b-bab0-452e-b585-5a97c13be429', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484c9817-5b39-4b72-ac5f-b28e7343379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:43 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Volume volume-3aa5090b-bab0-452e-b585-5a97c13be429 (3aa5090b-bab0-452e-b585-5a97c13be429): created successfully
Nov 05 18:52:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484c9817-5b39-4b72-ac5f-b28e7343379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:43 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Flow 'volume_create_manager' (e9444468-e340-4f51-ac85-f6f0f587da8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2efea51a-dadf-4438-b1a6-fdec9a7961ce tempest-CreateVolumesFromSnapshotTest-844119863 None] Created volume successfully.
Nov 05 18:52:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-3aa5090b-bab0-452e-b585-5a97c13be429-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-3aa5090b-bab0-452e-b585-5a97c13be429-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-quobyte-3aa5090b-bab0-452e-b585-5a97c13be429" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-3aa5090b-bab0-452e-b585-5a97c13be429" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:44 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba46d72-712d-400f-9f84-e6b6c554466b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:44 devstack sudo[106592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429
Nov 05 18:52:44 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:44 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429" returned: 0 in 0.522s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:44 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429
Nov 05 18:52:44 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:45 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3aa5090b-bab0-452e-b585-5a97c13be429" returned: 0 in 0.370s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-3aa5090b-bab0-452e-b585-5a97c13be429" released by "delete_volume" :: held 0.963s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Flow 'volume_create_manager' (92551a77-7cc4-4f11-97c6-c13ea7f709f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60c30ad-6db4-49c3-8c80-2961b1e985d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60c30ad-6db4-49c3-8c80-2961b1e985d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b039cac7-e57d-4470-aa67-bc5cd5dc006b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b373f7547e084409bc9946bbda33eae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:45Z,use_quota=True,user_id='2cfe8a34c7d641f18e525463ceac8c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1be8709-a282-4410-94f9-7bde5c5c4aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1be8709-a282-4410-94f9-7bde5c5c4aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f548f78-5e1f-434f-b0f0-b72bac3ea612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.image.glance [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Creating Keystone auth plugin from conf {{(pid=87086) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Created reservations ['f47f8667-2d29-4737-9282-f9968c3332da', '16f8e281-f80b-4efe-ad2e-64c98101d625', 'e252c282-4158-4b21-847f-b4c19b872674', '66ab4495-84ae-4b36-8199-3f48bfc1304f'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:45 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:45 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:45 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.315s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Deleted volume successfully.
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-6a043e85-80dc-4e72-98bd-db9c0405030d tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-3aa5090b-bab0-452e-b585-5a97c13be429-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f548f78-5e1f-434f-b0f0-b72bac3ea612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b039cac7-e57d-4470-aa67-bc5cd5dc006b', 'volume_name': 'volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b', 'volume_size': 1, 'image_id': 'acb238d4-12be-4399-85f4-c69757cedf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acb238d4-12be-4399-85f4-c69757cedf2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ff356814bb797fbe233f0ef3c26f339', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b373f7547e084409bc9946bbda33eae2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e8aadc7bb5c658911511e8ffbb37d16fcd7ebe772424cfa568303768109013bac01cbf8513aad2c309a3625d4ab7c9034c632b5c0a65caf05595c5064529fda6', 'id': 'acb238d4-12be-4399-85f4-c69757cedf2f', 'created_at': datetime.datetime(2026, 11, 5, 17, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acb238d4-12be-4399-85f4-c69757cedf2f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf4999cd0>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f764cc91-63fb-47d0-9385-7c80de9981fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f764cc91-63fb-47d0-9385-7c80de9981fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b793a2cf-72f6-4f3b-a0ed-0bed16b9beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:45 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Volume b039cac7-e57d-4470-aa67-bc5cd5dc006b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b', 'volume_size': 1, 'image_id': 'acb238d4-12be-4399-85f4-c69757cedf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acb238d4-12be-4399-85f4-c69757cedf2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ff356814bb797fbe233f0ef3c26f339', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b373f7547e084409bc9946bbda33eae2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e8aadc7bb5c658911511e8ffbb37d16fcd7ebe772424cfa568303768109013bac01cbf8513aad2c309a3625d4ab7c9034c632b5c0a65caf05595c5064529fda6', 'id': 'acb238d4-12be-4399-85f4-c69757cedf2f', 'created_at': datetime.datetime(2026, 11, 5, 17, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acb238d4-12be-4399-85f4-c69757cedf2f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf4999cd0>}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Trying to clone b039cac7-e57d-4470-aa67-bc5cd5dc006b from image acb238d4-12be-4399-85f4-c69757cedf2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/acb238d4-12be-4399-85f4-c69757cedf2f', 'metadata': {}}]). {{(pid=87086) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (7da09c80-db53-4239-8777-03b119e0467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137e3e24-e0e5-4812-87ac-e89e244c8ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137e3e24-e0e5-4812-87ac-e89e244c8ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835338438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd06703c-2785-4c11-b14d-6a3d3e2465c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:46Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1029aa2c-58f8-471d-ac1a-9dac8e121fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:45 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1029aa2c-58f8-471d-ac1a-9dac8e121fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e1e54c-95bb-4fd2-9aad-3c9784fdc4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e1e54c-95bb-4fd2-9aad-3c9784fdc4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd06703c-2785-4c11-b14d-6a3d3e2465c6', 'volume_name': 'volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdffa07b-16ef-4369-952d-e15822a68741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdffa07b-16ef-4369-952d-e15822a68741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45fb49e-2314-4b09-9c64-4064d97ea500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:46 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Volume dd06703c-2785-4c11-b14d-6a3d3e2465c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6', 'volume_size': 1}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835338438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd06703c-2785-4c11-b14d-6a3d3e2465c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:46Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Creating volume dd06703c-2785-4c11-b14d-6a3d3e2465c6 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:46 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 18:52:46 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 18:52:46 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 1073741824
Nov 05 18:52:46 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c34194-8a5a-484a-aa0b-b8e1810f7ee4]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:46 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD
Nov 05 18:52:46 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:46 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-quobyte-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a43482-2388-49c7-94d5-61429ed9cb99]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:46 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 1073741824" returned: 0 in 0.613s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:46 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD
Nov 05 18:52:46 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:46 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6
Nov 05 18:52:46 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:46 devstack sudo[106622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8
Nov 05 18:52:46 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:46 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:52:46 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Temporary image acb238d4-12be-4399-85f4-c69757cedf2f is fetched for user 2cfe8a34c7d641f18e525463ceac8c8d. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea5d231-364b-4dc4-b1bd-e4f2c8ab87df]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:47 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6" returned: 0 in 0.372s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45fb49e-2314-4b09-9c64-4064d97ea500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:47 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13201616-755d-4e8d-95e9-20a8de15467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8" returned: 0 in 0.477s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:47 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Volume volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 (dd06703c-2785-4c11-b14d-6a3d3e2465c6): created successfully
Nov 05 18:52:47 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8
Nov 05 18:52:47 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13201616-755d-4e8d-95e9-20a8de15467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (7da09c80-db53-4239-8777-03b119e0467e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-be677d07-4862-4e4c-a6fd-056d551e03a2 tempest-ProjectMemberTests-1907350922 None] Created volume successfully.
Nov 05 18:52:47 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD
Nov 05 18:52:47 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:47 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8" returned: 0 in 0.277s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:47 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8" released by "delete_volume" :: held 0.802s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Created reservations ['b048f826-741e-482b-8790-5d8e52b7bc00', '81b0b7e6-a6ba-40b3-a8a7-72ef27cfac4f', '55795470-4731-4935-8f8a-55b8e49aa3aa', '7772c284-42f0-42fe-a6a2-c731793e8a6e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:47 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD
Nov 05 18:52:47 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:47 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:47 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-924eef6e-29f7-4013-9aff-465800deaccc-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-924eef6e-29f7-4013-9aff-465800deaccc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-quobyte-924eef6e-29f7-4013-9aff-465800deaccc" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-924eef6e-29f7-4013-9aff-465800deaccc" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:47 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b039cac7-e57d-4470-aa67-bc5cd5dc006b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b373f7547e084409bc9946bbda33eae2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:45Z,use_quota=True,user_id='2cfe8a34c7d641f18e525463ceac8c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Creating volume b039cac7-e57d-4470-aa67-bc5cd5dc006b {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:47 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b712e5-9eff-4914-9845-d6e20c3216cf]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:47 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.274s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:47 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b 1073741824
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:47 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Deleted volume successfully.
Nov 05 18:52:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-74eeaa03-48bb-48ba-8b71-52314b568414 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-317d4595-6733-4bbf-b5fd-06b6c0ba5cb8-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:47 devstack sudo[106650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc
Nov 05 18:52:47 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:48 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc" returned: 0 in 0.445s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:48 devstack sudo[106660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc
Nov 05 18:52:48 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:48 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b 1073741824" returned: 0 in 0.535s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:48 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b
Nov 05 18:52:48 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:48 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-924eef6e-29f7-4013-9aff-465800deaccc" returned: 0 in 0.354s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-924eef6e-29f7-4013-9aff-465800deaccc" released by "delete_volume" :: held 0.867s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:48 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b" returned: 0 in 0.289s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.138s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Creating offline snapshot 02cd8a85-e9f8-4907-9b94-047083f91718 of volume dd06703c-2785-4c11-b14d-6a3d3e2465c6 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Created reservations ['a8ee2440-ddbe-445c-86d4-4ded4335e4be', 'ae79de5d-ae72-4bfa-b097-c224835b2993', '6a24b116-aa7c-47bc-88aa-770467d5cc92', '1a6df14d-4aab-4405-83e5-6b1c2649c3a2'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Attempting download of acb238d4-12be-4399-85f4-c69757cedf2f ((None, [{'url': 'file:///opt/stack/data/glance/images/acb238d4-12be-4399-85f4-c69757cedf2f', 'metadata': {}}])) to volume b039cac7-e57d-4470-aa67-bc5cd5dc006b. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[60399426-9b5f-4af4-9210-f5cdd673e38b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dd2e83-2dd7-48fe-bd17-94fd0547c1a1]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acb238d4-12be-4399-85f4-c69757cedf2f_gco2axi1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:48 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:48 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:48 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6
Nov 05 18:52:48 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:48 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acb238d4-12be-4399-85f4-c69757cedf2f_gco2axi1
Nov 05 18:52:48 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-quobyte-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d" acquired by "delete_volume" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[befadde5-c816-4613-8590-ace7d7efcefa]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:49 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_acb238d4-12be-4399-85f4-c69757cedf2f_gco2axi1" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acb238d4-12be-4399-85f4-c69757cedf2f_gco2axi1 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:49 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:49 devstack sudo[106673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d
Nov 05 18:52:49 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.449s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:49 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Deleted volume successfully.
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-d240dc9e-7ee7-4aa7-bf1b-20e85eca6695 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-924eef6e-29f7-4013-9aff-465800deaccc-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:49 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6" returned: 0 in 0.636s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:49 devstack sudo[106682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718 1G
Nov 05 18:52:49 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:49 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acb238d4-12be-4399-85f4-c69757cedf2f_gco2axi1
Nov 05 18:52:49 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:49 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d" returned: 0 in 0.471s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:49 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d
Nov 05 18:52:49 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:49 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acb238d4-12be-4399-85f4-c69757cedf2f_gco2axi1" returned: 1 in 0.450s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_acb238d4-12be-4399-85f4-c69757cedf2f_gco2axi1' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bdc62f-aa22-46d0-b195-4d92c81a4f4e]: (4, 'raw') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:49 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD
Nov 05 18:52:49 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:49 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718 1G" returned: 0 in 0.498s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:49 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d" returned: 0 in 0.283s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:49 devstack sudo[106698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718
Nov 05 18:52:49 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d" released by "delete_volume" :: held 0.828s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Created reservations ['caabb434-fa37-46b4-b9e3-7bbce067ad75', '6e005fe2-80b0-4a42-bf77-4baf4b1ae9c5', 'c4e31649-80a0-4251-8c9e-c2f417c90d46', '30e88f9a-ac27-4e9a-aa97-abf3677a088d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:50 devstack sudo[106701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:50 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:50 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-quobyte-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:50 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718" returned: 0 in 0.412s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:50 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718 is being set with open permissions: ugo+rw
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:50 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD
Nov 05 18:52:50 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5408c197-1f8c-46ff-a781-7905d7633c6b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:50 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718
Nov 05 18:52:50 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:50 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.385s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:50 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Deleted volume successfully.
Nov 05 18:52:50 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3
Nov 05 18:52:50 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-424062e5-00e7-41b2-a8cb-eb14720e2f92 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-2b7409f6-27c8-4cd1-a711-a4b0217f5f1d-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:50 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718" returned: 0 in 0.327s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:50 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD" returned: 1 in 0.504s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] acb238d4-12be-4399-85f4-c69757cedf2f was raw, converting to qcow2 {{(pid=87086) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:50 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b
Nov 05 18:52:50 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:50 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.info
Nov 05 18:52:50 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:50 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3" returned: 0 in 0.578s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:50 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3
Nov 05 18:52:50 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:50 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.info" returned: 0 in 0.302s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:50 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.info is being set with open permissions: ugo+rw
Nov 05 18:52:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:50 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.info
Nov 05 18:52:50 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:51 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3" returned: 0 in 0.328s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3" released by "delete_volume" :: held 1.003s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Created reservations ['2fab4d81-f641-412e-8a08-abb9006208d7', '58d417a8-9ae1-40de-8715-c8ac861b5f72', '7bd53e7c-0e2c-4083-81a5-76b0aa52e533', '9bf27a1d-77d3-40f2-b60c-a2747150a963'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:51 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b" returned: 0 in 0.697s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_acb238d4-12be-4399-85f4-c69757cedf2f_as0fligxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:52:51 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:51 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:51 devstack sudo[106737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b 1G
Nov 05 18:52:51 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.info" returned: 0 in 0.372s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.717s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:51 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c590fc27-8226-4887-960e-69e589f2b642 tempest-ProjectMemberTests-1907350922 None] Create snapshot completed successfully
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:51 devstack sudo[106739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:51 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:51 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b 1G" returned: 0 in 0.425s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Downloaded image acb238d4-12be-4399-85f4-c69757cedf2f ((None, [{'url': 'file:///opt/stack/data/glance/images/acb238d4-12be-4399-85f4-c69757cedf2f', 'metadata': {}}])) to volume b039cac7-e57d-4470-aa67-bc5cd5dc006b successfully. {{(pid=87086) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Temporary image acb238d4-12be-4399-85f4-c69757cedf2f for user 2cfe8a34c7d641f18e525463ceac8c8d is deleted. {{(pid=87086) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.volume_utils [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Marking volume b039cac7-e57d-4470-aa67-bc5cd5dc006b as bootable. {{(pid=87086) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 05 18:52:51 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Copying metadata from image acb238d4-12be-4399-85f4-c69757cedf2f to b039cac7-e57d-4470-aa67-bc5cd5dc006b. {{(pid=87086) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Creating volume glance metadata for volume b039cac7-e57d-4470-aa67-bc5cd5dc006b backed by image acb238d4-12be-4399-85f4-c69757cedf2f with: {'image_id': 'acb238d4-12be-4399-85f4-c69757cedf2f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2ff356814bb797fbe233f0ef3c26f339', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87086) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.300s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-02cd8a85-e9f8-4907-9b94-047083f91718-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:51 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Deleted volume successfully.
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Lock "cinder-02cd8a85-e9f8-4907-9b94-047083f91718-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-dd06703c-2785-4c11-b14d-6a3d3e2465c6" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-87004f63-5f61-482d-9ae5-a9fd723592d3 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-5c60bd8c-44b8-4a7f-a1a2-c6af9b7900b3-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-dd06703c-2785-4c11-b14d-6a3d3e2465c6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-02cd8a85-e9f8-4907-9b94-047083f91718" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-02cd8a85-e9f8-4907-9b94-047083f91718" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Deleting offline snapshot 02cd8a85-e9f8-4907-9b94-047083f91718 of volume dd06703c-2785-4c11-b14d-6a3d3e2465c6 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] snapshot_file for this snap is: volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd41d4f-111f-497a-869a-73d30db2b6c7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b793a2cf-72f6-4f3b-a0ed-0bed16b9beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b', 'volume_size': 1, 'image_id': 'acb238d4-12be-4399-85f4-c69757cedf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/acb238d4-12be-4399-85f4-c69757cedf2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2ff356814bb797fbe233f0ef3c26f339', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b373f7547e084409bc9946bbda33eae2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e8aadc7bb5c658911511e8ffbb37d16fcd7ebe772424cfa568303768109013bac01cbf8513aad2c309a3625d4ab7c9034c632b5c0a65caf05595c5064529fda6', 'id': 'acb238d4-12be-4399-85f4-c69757cedf2f', 'created_at': datetime.datetime(2026, 11, 5, 17, 52, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 17, 52, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/acb238d4-12be-4399-85f4-c69757cedf2f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bcf4999cd0>}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c140ce-eca1-4175-a85a-722897673ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:51 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Volume volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b (b039cac7-e57d-4470-aa67-bc5cd5dc006b): created successfully
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c140ce-eca1-4175-a85a-722897673ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:51 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Flow 'volume_create_manager' (92551a77-7cc4-4f11-97c6-c13ea7f709f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:51 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ecb10ace-750c-467a-8e1e-dbeb03b28051 tempest-VolumeImageDependencyTests-1180978963 None] Created volume successfully.
Nov 05 18:52:51 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718
Nov 05 18:52:51 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:52 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718" returned: 0 in 0.381s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1f5741-5fd8-4148-bf86-6c60211e5924]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:52 devstack sudo[106750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6
Nov 05 18:52:52 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-4fae40d7-fd92-48f9-8be1-187c2d011f6c-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-4fae40d7-fd92-48f9-8be1-187c2d011f6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-quobyte-fbd5a659-e10a-4c96-806f-58c2d2ba673d" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-fbd5a659-e10a-4c96-806f-58c2d2ba673d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-quobyte-4fae40d7-fd92-48f9-8be1-187c2d011f6c" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-4fae40d7-fd92-48f9-8be1-187c2d011f6c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Deleting offline snapshot 4fae40d7-fd92-48f9-8be1-187c2d011f6c of volume fbd5a659-e10a-4c96-806f-58c2d2ba673d {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] snapshot_file for this snap is: volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5353f89d-e623-44f2-bded-0fca569d47f4]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:52 devstack sudo[106752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c
Nov 05 18:52:52 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:52 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6" returned: 0 in 0.399s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:52 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718
Nov 05 18:52:52 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Acquiring lock "cinder-b039cac7-e57d-4470-aa67-bc5cd5dc006b-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Lock "cinder-b039cac7-e57d-4470-aa67-bc5cd5dc006b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Acquiring lock "cinder-quobyte-b039cac7-e57d-4470-aa67-bc5cd5dc006b" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Lock "cinder-quobyte-b039cac7-e57d-4470-aa67-bc5cd5dc006b" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:53 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c" returned: 0 in 0.519s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[340af4d7-802b-4779-8727-71fd0d324e87]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f4354-dbb6-4b4e-8276-ec3b2fcac0a9]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:53 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718" returned: 0 in 0.453s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:53 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718
Nov 05 18:52:53 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:53 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d
Nov 05 18:52:53 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:53 devstack sudo[106766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b
Nov 05 18:52:53 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:53 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6.02cd8a85-e9f8-4907-9b94-047083f91718" returned: 0 in 0.382s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:53 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d" returned: 0 in 0.494s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:53 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-02cd8a85-e9f8-4907-9b94-047083f91718" released by "_delete_snapshot" :: held 1.763s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b" returned: 0 in 0.531s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:53 devstack sudo[106815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c
Nov 05 18:52:53 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-dd06703c-2785-4c11-b14d-6a3d3e2465c6" released by "delete_snapshot" :: held 1.804s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:53 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b
Nov 05 18:52:53 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Created reservations ['6a68b0e3-6659-4424-bafa-73eee2150d31', '9827e7cf-e35b-4db0-ba63-78e6c970c198', '6cea5c6e-766c-4e9f-a1b3-a18b1ca770fe', '56e64d7b-c1a4-403e-89ce-951180a7e3e5'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:53 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Delete snapshot completed successfully.
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-0cf2cb45-b04f-40da-b687-9d465934a23b tempest-ProjectMemberTests-1907350922 None] Lock "cinder-02cd8a85-e9f8-4907-9b94-047083f91718-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:53 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-b039cac7-e57d-4470-aa67-bc5cd5dc006b" returned: 0 in 0.349s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Lock "cinder-quobyte-b039cac7-e57d-4470-aa67-bc5cd5dc006b" released by "delete_volume" :: held 0.948s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-dd06703c-2785-4c11-b14d-6a3d3e2465c6-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Created reservations ['89b06503-bc99-4517-8084-3f74741678a3', '40a3dbf7-ed46-4ed9-845e-dcec2a19047d', '850bb866-1d27-455c-a7cd-c58174a09a32', 'aeb496d9-fea6-4962-961e-b900cb0ccd36'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-dd06703c-2785-4c11-b14d-6a3d3e2465c6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:54 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-dd06703c-2785-4c11-b14d-6a3d3e2465c6" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c" returned: 0 in 0.590s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-dd06703c-2785-4c11-b14d-6a3d3e2465c6" acquired by "delete_volume" :: waited 0.043s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:54 devstack sudo[106825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c
Nov 05 18:52:54 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f495c6fa-7bee-4d9a-9879-8c1e4f75ed47]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:54 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:54 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:54 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6
Nov 05 18:52:54 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:54 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d.4fae40d7-fd92-48f9-8be1-187c2d011f6c" returned: 0 in 0.358s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-4fae40d7-fd92-48f9-8be1-187c2d011f6c" released by "_delete_snapshot" :: held 2.102s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:54 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-fbd5a659-e10a-4c96-806f-58c2d2ba673d" released by "delete_snapshot" :: held 2.129s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.328s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:54 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Deleted volume successfully.
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-56515f7b-b963-4a6a-80fa-df0d1a67a567 tempest-VolumeImageDependencyTests-1180978963 None] Lock "cinder-b039cac7-e57d-4470-aa67-bc5cd5dc006b-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Created reservations ['05468df2-860f-427c-920d-7bc4595e0e4c', '6e5405df-0cc5-40de-b87a-947b5a06386a', '6d04f0e7-4d51-4661-9125-bfd583084267', '05dcb906-1a9e-4b70-aec4-0d7d4d418560'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:54 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Delete snapshot completed successfully.
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e8006ae8-8c18-4f02-808f-a5df1039cff6 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-4fae40d7-fd92-48f9-8be1-187c2d011f6c-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:54 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6" returned: 0 in 0.519s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:54 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6
Nov 05 18:52:54 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:55 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-dd06703c-2785-4c11-b14d-6a3d3e2465c6" returned: 0 in 0.271s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-dd06703c-2785-4c11-b14d-6a3d3e2465c6" released by "delete_volume" :: held 0.905s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Created reservations ['4ec48cbc-71c6-4fe2-af2a-08db00c09d88', '8585a710-e06b-474a-909b-89fb9032da76', 'b2cbddc8-5e72-47c0-b8e4-e13af8f9ab08', '1bc81642-cacb-4e52-b6a9-234575c10b0c'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:55 devstack sudo[106839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:55 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:55 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.308s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:55 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Deleted volume successfully.
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c845a121-2ce9-4aa8-bda6-840e7a601427 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-dd06703c-2785-4c11-b14d-6a3d3e2465c6-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-fbd5a659-e10a-4c96-806f-58c2d2ba673d-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-fbd5a659-e10a-4c96-806f-58c2d2ba673d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "cinder-quobyte-fbd5a659-e10a-4c96-806f-58c2d2ba673d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-fbd5a659-e10a-4c96-806f-58c2d2ba673d" acquired by "delete_volume" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba97b09-c29c-46ad-9b59-1767a81c637f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:55 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d
Nov 05 18:52:55 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:56 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d" returned: 0 in 0.440s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:56 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d
Nov 05 18:52:56 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:56 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-fbd5a659-e10a-4c96-806f-58c2d2ba673d" returned: 0 in 0.413s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-quobyte-fbd5a659-e10a-4c96-806f-58c2d2ba673d" released by "delete_volume" :: held 0.957s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Created reservations ['47fdd15f-a9b1-48e4-b0e8-3327e074dfa4', '99c62508-4356-4c3e-bb90-2946bcfb2815', '0965cabe-430a-44f8-befc-54df317c3134', '1c061137-d673-40fd-bb68-c9f98288f5ec'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:56 devstack sudo[106851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:52:56 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (82d1aaf3-6a64-4929-9fe3-94f3001b7dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7b3b11-3015-4d54-a56b-4f5327ed701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7b3b11-3015-4d54-a56b-4f5327ed701d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-658555686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb27c0b-b121-428e-a5e0-da550d097e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:57Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef209bd-b5ec-4baf-b59c-7ed26222b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef209bd-b5ec-4baf-b59c-7ed26222b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0374a587-b146-47e1-a1ad-0b80a67220f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0374a587-b146-47e1-a1ad-0b80a67220f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb27c0b-b121-428e-a5e0-da550d097e08', 'volume_name': 'volume-ffb27c0b-b121-428e-a5e0-da550d097e08', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b9632f-d619-4bcc-9f17-78d3632fa520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b9632f-d619-4bcc-9f17-78d3632fa520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cf042b-513d-4565-a90d-2ea846722876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:57 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Volume ffb27c0b-b121-428e-a5e0-da550d097e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb27c0b-b121-428e-a5e0-da550d097e08', 'volume_size': 1}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-658555686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb27c0b-b121-428e-a5e0-da550d097e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:52:57Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Creating volume ffb27c0b-b121-428e-a5e0-da550d097e08 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:52:57 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:57 devstack sudo[106854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08 1073741824
Nov 05 18:52:57 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:57 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.306s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:52:57 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Deleted volume successfully.
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-829f3aa3-699b-413f-8f45-e90ea40a5390 tempest-CreateVolumesFromSnapshotTest-844119863 None] Lock "cinder-fbd5a659-e10a-4c96-806f-58c2d2ba673d-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:52:57 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08 1073741824" returned: 0 in 0.606s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:57 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08
Nov 05 18:52:57 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:52:58 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Nov 05 18:52:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08" returned: 0 in 0.331s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:52:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:52:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:52:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cf042b-513d-4565-a90d-2ea846722876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb27c0b-b121-428e-a5e0-da550d097e08', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aea9dfb-b79f-40e1-9bfd-55e606d495b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:52:58 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Volume volume-ffb27c0b-b121-428e-a5e0-da550d097e08 (ffb27c0b-b121-428e-a5e0-da550d097e08): created successfully
Nov 05 18:52:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aea9dfb-b79f-40e1-9bfd-55e606d495b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:52:58 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (82d1aaf3-6a64-4929-9fe3-94f3001b7dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:52:58 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3aabbc8d-0ecb-43fe-9040-a658142d0b71 tempest-ProjectMemberTests-1907350922 None] Created volume successfully.
Nov 05 18:52:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:52:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:52:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Creating offline snapshot 6a54cfd1-b44f-4a62-ac3c-e00a2a860087 of volume ffb27c0b-b121-428e-a5e0-da550d097e08 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:52:59 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c92b74-306c-46b5-9002-79f6117dbb70]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:52:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:52:59 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08
Nov 05 18:52:59 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:00 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08" returned: 0 in 0.527s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:00 devstack sudo[106869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087 1G
Nov 05 18:53:00 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:00 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087 1G" returned: 0 in 0.513s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb27c0b-b121-428e-a5e0-da550d097e08 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:00 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb27c0b-b121-428e-a5e0-da550d097e08 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087
Nov 05 18:53:00 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:00 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffb27c0b-b121-428e-a5e0-da550d097e08 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087" returned: 0 in 0.326s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:00 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087 is being set with open permissions: ugo+rw
Nov 05 18:53:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:01 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087
Nov 05 18:53:01 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:01 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087" returned: 0 in 0.469s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:01 devstack sudo[106883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.info
Nov 05 18:53:01 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:01 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.info" returned: 0 in 0.357s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:01 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.info is being set with open permissions: ugo+rw
Nov 05 18:53:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:01 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.info
Nov 05 18:53:01 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:02 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.info" returned: 0 in 0.369s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:02 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-763d4ac4-d4f0-4f40-b56c-370f70a051be tempest-ProjectMemberTests-1907350922 None] Create snapshot completed successfully
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-6a54cfd1-b44f-4a62-ac3c-e00a2a860087-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-6a54cfd1-b44f-4a62-ac3c-e00a2a860087-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-ffb27c0b-b121-428e-a5e0-da550d097e08" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-ffb27c0b-b121-428e-a5e0-da550d097e08" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-6a54cfd1-b44f-4a62-ac3c-e00a2a860087" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Flow 'volume_create_manager' (66c1a1dd-d13b-4d8f-a0e4-2bc9e0bb8b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10001ead-82ed-4f30-8859-fff0f4dfe0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-6a54cfd1-b44f-4a62-ac3c-e00a2a860087" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Deleting offline snapshot 6a54cfd1-b44f-4a62-ac3c-e00a2a860087 of volume ffb27c0b-b121-428e-a5e0-da550d097e08 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] snapshot_file for this snap is: volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10001ead-82ed-4f30-8859-fff0f4dfe0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-293112737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068b1bf4-8daf-422f-a907-33f06dca87a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e878c03e7b4f34b90aafae340e23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:03Z,use_quota=True,user_id='52fb514713954db993d8d60d006dcb4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b455c053-731e-4d9f-9f6f-7b1cab1b4452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b455c053-731e-4d9f-9f6f-7b1cab1b4452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5f7211-0453-4487-ba82-3edec5875347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d5f7211-0453-4487-ba82-3edec5875347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '068b1bf4-8daf-422f-a907-33f06dca87a8', 'volume_name': 'volume-068b1bf4-8daf-422f-a907-33f06dca87a8', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5739b7f0-16ba-46b0-bce3-90644713a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5739b7f0-16ba-46b0-bce3-90644713a160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e90cc7-c12d-44df-b379-e3dd3fe852d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Volume 068b1bf4-8daf-422f-a907-33f06dca87a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-068b1bf4-8daf-422f-a907-33f06dca87a8', 'volume_size': 1}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-293112737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068b1bf4-8daf-422f-a907-33f06dca87a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e878c03e7b4f34b90aafae340e23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:03Z,use_quota=True,user_id='52fb514713954db993d8d60d006dcb4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Creating volume 068b1bf4-8daf-422f-a907-33f06dca87a8 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:53:02 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b79796b-289c-4a92-b28c-c9d1ae9eb071]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:03 devstack sudo[106889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 1073741824
Nov 05 18:53:03 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:03 devstack sudo[106890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087
Nov 05 18:53:03 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:03 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087" returned: 0 in 0.427s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffb27c0b-b121-428e-a5e0-da550d097e08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b53535f-04c1-4993-90eb-d9f3614cffd8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:03 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 1073741824" returned: 0 in 0.569s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:03 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08
Nov 05 18:53:03 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:03 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8
Nov 05 18:53:03 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:03 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8" returned: 0 in 0.335s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e90cc7-c12d-44df-b379-e3dd3fe852d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-068b1bf4-8daf-422f-a907-33f06dca87a8', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:03 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca17546-e9cc-4f94-9368-6aa9828fd272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08" returned: 0 in 0.507s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:03 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Volume volume-068b1bf4-8daf-422f-a907-33f06dca87a8 (068b1bf4-8daf-422f-a907-33f06dca87a8): created successfully
Nov 05 18:53:03 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca17546-e9cc-4f94-9368-6aa9828fd272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:03 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Flow 'volume_create_manager' (66c1a1dd-d13b-4d8f-a0e4-2bc9e0bb8b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fef65cdb-bb8a-4ccd-8cb0-0a81efa8aa0a tempest-VolumeDependencyTests-1292475279 None] Created volume successfully.
Nov 05 18:53:04 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087" returned: 0 in 0.442s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:04 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087
Nov 05 18:53:04 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:04 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08.6a54cfd1-b44f-4a62-ac3c-e00a2a860087" returned: 0 in 0.313s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-6a54cfd1-b44f-4a62-ac3c-e00a2a860087" released by "_delete_snapshot" :: held 1.881s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-ffb27c0b-b121-428e-a5e0-da550d097e08" released by "delete_snapshot" :: held 1.949s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:04 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Created reservations ['5ef135f3-19a3-4a18-88e9-aff7881bb0fc', '51f8fec6-deec-438e-9dd8-fac618150331', '040ba455-eb52-475b-8c5a-01ca1ce4b13c', '13988cef-9ce6-43e2-b1c4-f761f0cd17ac'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Delete snapshot completed successfully.
Nov 05 18:53:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-7fd94010-9666-411c-8f67-90522431e615 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-6a54cfd1-b44f-4a62-ac3c-e00a2a860087-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Creating offline snapshot 5a667c67-030c-49cc-9db9-9288802b7932 of volume 068b1bf4-8daf-422f-a907-33f06dca87a8 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-ffb27c0b-b121-428e-a5e0-da550d097e08-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Lock "cinder-ffb27c0b-b121-428e-a5e0-da550d097e08-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c9601c-60c2-4605-990d-c74451968151]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-ffb27c0b-b121-428e-a5e0-da550d097e08" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:05 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8
Nov 05 18:53:05 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-ffb27c0b-b121-428e-a5e0-da550d097e08" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cbd2a1-f346-4684-b812-1f3cf786f9ce]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:05 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08
Nov 05 18:53:05 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:05 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8" returned: 0 in 0.497s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:05 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 1G
Nov 05 18:53:05 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:06 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08" returned: 0 in 0.498s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:06 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08
Nov 05 18:53:06 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:06 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ffb27c0b-b121-428e-a5e0-da550d097e08" returned: 0 in 0.349s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:06 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 1G" returned: 0 in 0.603s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-068b1bf4-8daf-422f-a907-33f06dca87a8 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-ffb27c0b-b121-428e-a5e0-da550d097e08" released by "delete_volume" :: held 0.980s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:06 devstack sudo[106936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-068b1bf4-8daf-422f-a907-33f06dca87a8 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932
Nov 05 18:53:06 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Created reservations ['7d0cea70-c752-4ada-8685-5ac920a0d24f', '2e36a9ef-1003-4c62-9e34-aebe07270a8b', '3e6ca273-c272-44f1-ae39-f0435f7c5537', '37aa92d7-c92a-45ae-8707-9a12234f5db3'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:06 devstack sudo[106938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:53:06 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:06 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-068b1bf4-8daf-422f-a907-33f06dca87a8 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932" returned: 0 in 0.398s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:06 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 is being set with open permissions: ugo+rw
Nov 05 18:53:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:06 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932
Nov 05 18:53:06 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:07 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.342s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:07 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:53:07 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Deleted volume successfully.
Nov 05 18:53:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c021aa54-4d38-4666-a5ff-3e7cec2dd14c tempest-ProjectMemberTests-1907350922 None] Lock "cinder-ffb27c0b-b121-428e-a5e0-da550d097e08-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:07 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932" returned: 0 in 0.314s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:07 devstack sudo[106947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.info
Nov 05 18:53:07 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:07 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.info" returned: 0 in 0.371s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:07 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.info is being set with open permissions: ugo+rw
Nov 05 18:53:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:07 devstack sudo[106950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.info
Nov 05 18:53:07 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:07 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.info" returned: 0 in 0.284s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:07 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-62f8dc05-3b0a-4776-88ea-77de3c626b7c tempest-VolumeDependencyTests-1292475279 None] Create snapshot completed successfully
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (b86308e4-3546-4cf9-91d0-1bb7cfdf30cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (518e7805-7d56-4f00-aa0a-08c43d1ef612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (518e7805-7d56-4f00-aa0a-08c43d1ef612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509791282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b078cfa-7afe-4e3a-964b-fddbf3fb334d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:08Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d71718-99b2-4955-a26b-a880a656b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d71718-99b2-4955-a26b-a880a656b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77dba98-7b3b-4a63-bc34-4174b170c767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77dba98-7b3b-4a63-bc34-4174b170c767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b078cfa-7afe-4e3a-964b-fddbf3fb334d', 'volume_name': 'volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af49316-ac0a-462c-b5d3-2d6f6e13b850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af49316-ac0a-462c-b5d3-2d6f6e13b850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2efcea-da07-4875-b990-c3df03cc1592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:08 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Volume 1b078cfa-7afe-4e3a-964b-fddbf3fb334d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d', 'volume_size': 1}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509791282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b078cfa-7afe-4e3a-964b-fddbf3fb334d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:08Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Creating volume 1b078cfa-7afe-4e3a-964b-fddbf3fb334d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:53:08 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:08 devstack sudo[106953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d 1073741824
Nov 05 18:53:08 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:08 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d 1073741824" returned: 0 in 0.638s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:09 devstack sudo[106959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d
Nov 05 18:53:09 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Flow 'volume_create_manager' (3cc762cd-183b-4765-ad63-b01762bd5155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5aac711-7553-443b-a234-9e416287c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5aac711-7553-443b-a234-9e416287c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-264594861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8d708b-132c-41a3-ba15-e881e2f5310c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e878c03e7b4f34b90aafae340e23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a667c67-030c-49cc-9db9-9288802b7932,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:09Z,use_quota=True,user_id='52fb514713954db993d8d60d006dcb4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27589ff6-e52f-404c-a16d-1c32bbf035e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27589ff6-e52f-404c-a16d-1c32bbf035e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f4c4d6-24a4-4d5b-b355-40b62a9db324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f4c4d6-24a4-4d5b-b355-40b62a9db324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3d8d708b-132c-41a3-ba15-e881e2f5310c', 'volume_name': 'volume-3d8d708b-132c-41a3-ba15-e881e2f5310c', 'volume_size': 1, 'snapshot_id': '5a667c67-030c-49cc-9db9-9288802b7932'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bba8d6-a5fa-47f6-8d69-1688abce34ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95bba8d6-a5fa-47f6-8d69-1688abce34ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5245ba1c-d7a0-49d9-8c03-657248d60c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:09 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Volume 3d8d708b-132c-41a3-ba15-e881e2f5310c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3d8d708b-132c-41a3-ba15-e881e2f5310c', 'volume_size': 1, 'snapshot_id': '5a667c67-030c-49cc-9db9-9288802b7932'}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:09 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" returned: 0 in 0.400s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.196s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "cinder-quobyte-5a667c67-030c-49cc-9db9-9288802b7932-3d8d708b-132c-41a3-ba15-e881e2f5310c" by "_create_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2efcea-da07-4875-b990-c3df03cc1592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de4042f-6066-4be2-b9a5-09f03a2aff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-5a667c67-030c-49cc-9db9-9288802b7932-3d8d708b-132c-41a3-ba15-e881e2f5310c" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Creating volume 3d8d708b-132c-41a3-ba15-e881e2f5310c from snapshot 5a667c67-030c-49cc-9db9-9288802b7932 {{(pid=87086) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "cinder-quobyte-3d8d708b-132c-41a3-ba15-e881e2f5310c" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:09 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Volume volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d (1b078cfa-7afe-4e3a-964b-fddbf3fb334d): created successfully
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de4042f-6066-4be2-b9a5-09f03a2aff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (b86308e4-3546-4cf9-91d0-1bb7cfdf30cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-3d8d708b-132c-41a3-ba15-e881e2f5310c" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] snapshot: 5a667c67-030c-49cc-9db9-9288802b7932, volume: 3d8d708b-132c-41a3-ba15-e881e2f5310c,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:53:09 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-28daa65b-2d49-4127-9171-8351103217ca tempest-ProjectMemberTests-1907350922 None] Created volume successfully.
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f300653-3714-4ae0-bc3d-2876aca30e9e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:09 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932
Nov 05 18:53:09 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:10 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932" returned: 0 in 0.447s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-068b1bf4-8daf-422f-a907-33f06dca87a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20b3f0c-4bc3-44d5-b900-6bf22d118ab4]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:10 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8
Nov 05 18:53:10 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:10 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8" returned: 0 in 0.498s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=289,cinder:SELECT=233,cinder:INSERT=80,cinder:DELETE=23 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:53:10 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c
Nov 05 18:53:10 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=202,cinder:UPDATE=296,cinder:INSERT=77,cinder:DELETE=30 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:53:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:18 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c" returned: 0 in 8.039s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:18 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:53:18 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Converted 1024.00 MB image at 127.37 MB/s
Nov 05 18:53:18 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c is being set with open permissions: ugo+rw
Nov 05 18:53:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:18 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c
Nov 05 18:53:18 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:18 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c" returned: 0 in 0.277s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-3d8d708b-132c-41a3-ba15-e881e2f5310c" released by "_copy_volume_from_snapshot" :: held 9.386s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-5a667c67-030c-49cc-9db9-9288802b7932-3d8d708b-132c-41a3-ba15-e881e2f5310c" released by "_create_volume_from_snapshot" :: held 9.501s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.535s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.357s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:18 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Creating offline snapshot 84928a44-14dd-4133-8302-1231f017515d of volume 1b078cfa-7afe-4e3a-964b-fddbf3fb334d {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:53:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5245ba1c-d7a0-49d9-8c03-657248d60c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8d708b-132c-41a3-ba15-e881e2f5310c', 'volume_size': 1, 'snapshot_id': '5a667c67-030c-49cc-9db9-9288802b7932'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d623af44-5a03-4325-a651-93fbdfbb66bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:19 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab444c2-c288-42cb-a2c3-84aa961efd65]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:19 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Volume volume-3d8d708b-132c-41a3-ba15-e881e2f5310c (3d8d708b-132c-41a3-ba15-e881e2f5310c): created successfully
Nov 05 18:53:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d623af44-5a03-4325-a651-93fbdfbb66bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:19 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Flow 'volume_create_manager' (3cc762cd-183b-4765-ad63-b01762bd5155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:19 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-be80b56c-9a51-4598-b478-8302aaba3139 tempest-VolumeDependencyTests-1292475279 None] Created volume successfully.
Nov 05 18:53:19 devstack sudo[106989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d
Nov 05 18:53:19 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:19 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" returned: 0 in 0.520s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:19 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d 1G
Nov 05 18:53:19 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "cinder-5a667c67-030c-49cc-9db9-9288802b7932-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-5a667c67-030c-49cc-9db9-9288802b7932-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "cinder-quobyte-068b1bf4-8daf-422f-a907-33f06dca87a8" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:20 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-068b1bf4-8daf-422f-a907-33f06dca87a8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "cinder-quobyte-5a667c67-030c-49cc-9db9-9288802b7932" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d 1G" returned: 0 in 0.702s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-5a667c67-030c-49cc-9db9-9288802b7932" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Deleting offline snapshot 5a667c67-030c-49cc-9db9-9288802b7932 of volume 068b1bf4-8daf-422f-a907-33f06dca87a8 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:53:20 devstack sudo[107001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d
Nov 05 18:53:20 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] snapshot_file for this snap is: volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e4571-8b5a-42fa-9c5f-c2950d477e22]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:20 devstack sudo[107003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932
Nov 05 18:53:20 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:20 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d" returned: 0 in 0.426s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:20 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d is being set with open permissions: ugo+rw
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:20 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d
Nov 05 18:53:20 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:20 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932" returned: 0 in 0.493s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-068b1bf4-8daf-422f-a907-33f06dca87a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[928ca7e7-7020-492f-8acc-5a4b058e36cc]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:21 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d" returned: 0 in 0.315s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:21 devstack sudo[107014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8
Nov 05 18:53:21 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:21 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.info
Nov 05 18:53:21 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:21 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.info" returned: 0 in 0.491s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:21 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.info is being set with open permissions: ugo+rw
Nov 05 18:53:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:21 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.info
Nov 05 18:53:21 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:21 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8" returned: 0 in 0.805s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:21 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932
Nov 05 18:53:21 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:21 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.info" returned: 0 in 0.330s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-3e19ddf9-4853-440e-af97-2f14cd8e8ba7 tempest-ProjectMemberTests-1907350922 None] Create snapshot completed successfully
Nov 05 18:53:22 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932" returned: 0 in 0.453s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:22 devstack sudo[107032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932
Nov 05 18:53:22 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:22 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8.5a667c67-030c-49cc-9db9-9288802b7932" returned: 0 in 0.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-5a667c67-030c-49cc-9db9-9288802b7932" released by "_delete_snapshot" :: held 2.216s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-068b1bf4-8daf-422f-a907-33f06dca87a8" released by "delete_snapshot" :: held 2.270s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Created reservations ['4386ccaa-a257-4db0-a434-4a6b201a13c5', 'c030580a-f160-4a78-b57b-efd1373cbb53', '229c0cef-6e48-41ee-a7f4-2cede52aed95', '585d66f7-7f4f-4072-8566-f0d557578fe1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:22 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Delete snapshot completed successfully.
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4529c3b8-684d-4497-8183-7311a184ae8b tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-5a667c67-030c-49cc-9db9-9288802b7932-delete_snapshot" released by "delete_snapshot" :: held 2.467s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-84928a44-14dd-4133-8302-1231f017515d-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-84928a44-14dd-4133-8302-1231f017515d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-84928a44-14dd-4133-8302-1231f017515d" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-84928a44-14dd-4133-8302-1231f017515d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Deleting offline snapshot 84928a44-14dd-4133-8302-1231f017515d of volume 1b078cfa-7afe-4e3a-964b-fddbf3fb334d {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] snapshot_file for this snap is: volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28041f1-1f9d-4f21-9906-6aa9c3787ac8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:23 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d
Nov 05 18:53:23 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:23 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d" returned: 0 in 0.454s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5fad8e-368e-43a0-a8ab-7880034dc26e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:23 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d
Nov 05 18:53:23 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "cinder-068b1bf4-8daf-422f-a907-33f06dca87a8-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-068b1bf4-8daf-422f-a907-33f06dca87a8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "cinder-quobyte-068b1bf4-8daf-422f-a907-33f06dca87a8" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-068b1bf4-8daf-422f-a907-33f06dca87a8" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d3fcdd-476e-49b3-9944-ac4eb90e71d4]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:23 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" returned: 0 in 0.468s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:23 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8
Nov 05 18:53:23 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:23 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d
Nov 05 18:53:23 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:24 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8" returned: 0 in 0.417s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:24 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8
Nov 05 18:53:24 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:24 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d" returned: 0 in 0.406s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:24 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d
Nov 05 18:53:24 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:24 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-068b1bf4-8daf-422f-a907-33f06dca87a8" returned: 0 in 0.277s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-068b1bf4-8daf-422f-a907-33f06dca87a8" released by "delete_volume" :: held 0.807s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Created reservations ['0f19548c-2a43-4d9b-a651-63a2c3d34918', 'd2551518-4ebe-4bb7-aadc-d2d637ffa112', '707b2463-effd-429d-87ef-604267ba1ba4', 'e0248b2f-7b9f-4736-b134-76f875bd10f3'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:24 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d.84928a44-14dd-4133-8302-1231f017515d" returned: 0 in 0.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-84928a44-14dd-4133-8302-1231f017515d" released by "_delete_snapshot" :: held 1.762s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" released by "delete_snapshot" :: held 1.796s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:24 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:53:24 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Created reservations ['d100a7a6-dfa2-4298-8192-05c978bd1db8', '6c2277a6-1990-46bb-ace4-034be9744515', 'bd42e7ad-6d8c-4fa7-b8e8-5e5423cfd450', 'b0dc06d3-cfc3-4081-933d-16d61debb610'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "cinder-3d8d708b-132c-41a3-ba15-e881e2f5310c-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-3d8d708b-132c-41a3-ba15-e881e2f5310c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Delete snapshot completed successfully.
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b35e0a84-fac1-47b6-8e4d-ebe29e31ebb0 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-84928a44-14dd-4133-8302-1231f017515d-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "cinder-quobyte-3d8d708b-132c-41a3-ba15-e881e2f5310c" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-3d8d708b-132c-41a3-ba15-e881e2f5310c" acquired by "delete_volume" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92ec5c8-aaef-42b8-8f24-51fac8d41b7e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-1b078cfa-7afe-4e3a-964b-fddbf3fb334d-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-1b078cfa-7afe-4e3a-964b-fddbf3fb334d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:25 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:25 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c
Nov 05 18:53:25 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.503s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:53:25 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Deleted volume successfully.
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd1f4ff-9ef0-4701-9831-e5d3cd3c819a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8d0c7f1e-6782-47a2-baab-b4b91fa4594d tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-068b1bf4-8daf-422f-a907-33f06dca87a8-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:25 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d
Nov 05 18:53:25 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:25 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c" returned: 0 in 0.526s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:25 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c
Nov 05 18:53:25 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:25 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" returned: 0 in 0.471s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:25 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:53:25 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:25 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d
Nov 05 18:53:25 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:25 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-3d8d708b-132c-41a3-ba15-e881e2f5310c" returned: 0 in 0.320s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-quobyte-3d8d708b-132c-41a3-ba15-e881e2f5310c" released by "delete_volume" :: held 0.922s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Created reservations ['ea33c8ae-55bc-4042-8179-2617ef6126b8', 'aa93cffd-4b79-4dc0-a0cf-3493bfb3fd8d', '169dd74f-5861-4971-ab55-ebd1e1dfc75a', '7fa995a3-ed02-445a-80cf-ae725448c4c7'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:25 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.359s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:53:25 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:53:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" returned: 0 in 0.361s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-1b078cfa-7afe-4e3a-964b-fddbf3fb334d" released by "delete_volume" :: held 0.937s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:26 devstack sudo[107088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:53:26 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Created reservations ['bb2c7ee2-6632-4a2b-85f5-c08a6f421716', '18e8e8ff-289c-4acb-a713-6dbc6ac0f9dc', '8c7de2ca-7d07-49d9-82e4-47bc224c4030', 'b724fd2f-7d30-426f-b6f5-66c6014e1be9'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:26 devstack sudo[107090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:53:26 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:26 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.341s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:53:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Deleted volume successfully.
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8ed1cfd3-509e-4606-af81-14ac1cf27e87 tempest-VolumeDependencyTests-1292475279 None] Lock "cinder-3d8d708b-132c-41a3-ba15-e881e2f5310c-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:26 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.312s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:53:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Deleted volume successfully.
Nov 05 18:53:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5231b484-005c-43de-8928-e84a473f8bc7 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-1b078cfa-7afe-4e3a-964b-fddbf3fb334d-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (787eeb5e-3c08-4ebc-b7fa-38a2316492ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7ed654-2600-4c44-a625-940e575f7376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7ed654-2600-4c44-a625-940e575f7376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203678585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca83f855-8284-4972-a79c-eec280b41f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:28Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fbfae7-9bea-4619-aade-5f44d3af27b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fbfae7-9bea-4619-aade-5f44d3af27b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25809145-62c3-4551-af5b-e54d4843ca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25809145-62c3-4551-af5b-e54d4843ca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca83f855-8284-4972-a79c-eec280b41f19', 'volume_name': 'volume-ca83f855-8284-4972-a79c-eec280b41f19', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769d24b3-01c2-4290-8e68-52b362fc4fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769d24b3-01c2-4290-8e68-52b362fc4fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f311dd97-00ee-40d0-a8bb-93b653dce6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:27 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Volume ca83f855-8284-4972-a79c-eec280b41f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca83f855-8284-4972-a79c-eec280b41f19', 'volume_size': 1}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1203678585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca83f855-8284-4972-a79c-eec280b41f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:28Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Creating volume ca83f855-8284-4972-a79c-eec280b41f19 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:53:28 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:28 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19 1073741824
Nov 05 18:53:28 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:28 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19 1073741824" returned: 0 in 0.573s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:28 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19
Nov 05 18:53:28 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:28 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19" returned: 0 in 0.323s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f311dd97-00ee-40d0-a8bb-93b653dce6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca83f855-8284-4972-a79c-eec280b41f19', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59234a4c-9439-4767-bf9c-cbe1c1cae172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:28 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Volume volume-ca83f855-8284-4972-a79c-eec280b41f19 (ca83f855-8284-4972-a79c-eec280b41f19): created successfully
Nov 05 18:53:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59234a4c-9439-4767-bf9c-cbe1c1cae172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (787eeb5e-3c08-4ebc-b7fa-38a2316492ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a1d3e326-be3c-410b-a798-c691b7341313 tempest-ProjectMemberTests-1907350922 None] Created volume successfully.
Nov 05 18:53:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Creating offline snapshot 0ba9f7e3-82ac-4f98-b32a-1350b89c8807 of volume ca83f855-8284-4972-a79c-eec280b41f19 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:53:30 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be9abd8-287a-42b1-9fdb-3dac521404c3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:30 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19
Nov 05 18:53:30 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:30 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19" returned: 0 in 0.428s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:30 devstack sudo[107109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807 1G
Nov 05 18:53:30 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:31 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807 1G" returned: 0 in 0.529s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca83f855-8284-4972-a79c-eec280b41f19 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:31 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca83f855-8284-4972-a79c-eec280b41f19 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807
Nov 05 18:53:31 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:31 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca83f855-8284-4972-a79c-eec280b41f19 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807" returned: 0 in 0.354s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:31 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807 is being set with open permissions: ugo+rw
Nov 05 18:53:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:31 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807
Nov 05 18:53:31 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:31 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807" returned: 0 in 0.288s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:31 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.info
Nov 05 18:53:31 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:32 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.info" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:32 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.info is being set with open permissions: ugo+rw
Nov 05 18:53:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:32 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.info
Nov 05 18:53:32 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:32 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.info" returned: 0 in 0.353s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:32 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fd4755ec-50db-4265-9a4a-16d2259b5146 tempest-ProjectMemberTests-1907350922 None] Create snapshot completed successfully
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-0ba9f7e3-82ac-4f98-b32a-1350b89c8807-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Lock "cinder-0ba9f7e3-82ac-4f98-b32a-1350b89c8807-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-ca83f855-8284-4972-a79c-eec280b41f19" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-ca83f855-8284-4972-a79c-eec280b41f19" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-0ba9f7e3-82ac-4f98-b32a-1350b89c8807" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-0ba9f7e3-82ac-4f98-b32a-1350b89c8807" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Deleting offline snapshot 0ba9f7e3-82ac-4f98-b32a-1350b89c8807 of volume ca83f855-8284-4972-a79c-eec280b41f19 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] snapshot_file for this snap is: volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[0271e893-7cd2-4f03-99c9-f6684f944720]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:33 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807
Nov 05 18:53:33 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:33 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807" returned: 0 in 0.420s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:33 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca83f855-8284-4972-a79c-eec280b41f19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:53:34 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d64acd-021f-4c64-a904-e17469f4ea40]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:34 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19
Nov 05 18:53:34 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:34 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19" returned: 0 in 0.547s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:34 devstack sudo[107140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807
Nov 05 18:53:34 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:34 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807" returned: 0 in 0.430s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:35 devstack sudo[107146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807
Nov 05 18:53:35 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:35 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19.0ba9f7e3-82ac-4f98-b32a-1350b89c8807" returned: 0 in 0.290s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-0ba9f7e3-82ac-4f98-b32a-1350b89c8807" released by "_delete_snapshot" :: held 1.849s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-ca83f855-8284-4972-a79c-eec280b41f19" released by "delete_snapshot" :: held 1.877s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Created reservations ['52f9889d-93bc-4fae-be9e-8d94f2ab9cc1', '0e25973b-6bcb-4ecb-8ed9-770a7bdd8ee2', '79adfca9-e546-45ff-81bb-ec1f50541f57', 'd50631b9-497c-4a03-b5f4-44cb48b56ee6'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:35 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Delete snapshot completed successfully.
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c3991351-768c-4c5e-81bc-149d2dbcbefb tempest-ProjectMemberTests-1907350922 None] Lock "cinder-0ba9f7e3-82ac-4f98-b32a-1350b89c8807-delete_snapshot" released by "delete_snapshot" :: held 2.047s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-ca83f855-8284-4972-a79c-eec280b41f19-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-ca83f855-8284-4972-a79c-eec280b41f19-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-ca83f855-8284-4972-a79c-eec280b41f19" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-ca83f855-8284-4972-a79c-eec280b41f19" acquired by "delete_volume" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a3c539-5cb8-47ce-a697-968d7c69ee8f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:35 devstack sudo[107150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19
Nov 05 18:53:35 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:36 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19" returned: 0 in 0.439s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:36 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19
Nov 05 18:53:36 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:36 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ca83f855-8284-4972-a79c-eec280b41f19" returned: 0 in 0.386s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-ca83f855-8284-4972-a79c-eec280b41f19" released by "delete_volume" :: held 0.918s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Created reservations ['70cbbba2-671c-459c-a05a-f900e5774aa7', '74b297dc-67ef-4300-b718-55a9b3641f6c', '64d17154-20e9-4d99-bd84-ddf2997eacc0', '1ef1abd3-b0de-4345-8d64-4e50584b51d6'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:36 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:53:36 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:37 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.309s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:37 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:53:37 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Deleted volume successfully.
Nov 05 18:53:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-07e391f9-140d-47a0-9b58-8eec8c738ff8 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-ca83f855-8284-4972-a79c-eec280b41f19-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (ae38b9d1-d862-448b-a17f-86ace238ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486167d5-163c-4ff3-99fe-1f6f5b4582ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486167d5-163c-4ff3-99fe-1f6f5b4582ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2059040488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79006f8e-8996-4e26-be89-948e24a77d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:39Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e26f8d4-e468-4988-976c-be299e2f5f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e26f8d4-e468-4988-976c-be299e2f5f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14b5734-00fe-43e3-ade8-aae41c093773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14b5734-00fe-43e3-ade8-aae41c093773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79006f8e-8996-4e26-be89-948e24a77d5e', 'volume_name': 'volume-79006f8e-8996-4e26-be89-948e24a77d5e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3445c19-8520-4228-921d-b4dcd5262d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3445c19-8520-4228-921d-b4dcd5262d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24187a3a-01a0-4ef9-84e1-632d7338a603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:38 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Volume 79006f8e-8996-4e26-be89-948e24a77d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79006f8e-8996-4e26-be89-948e24a77d5e', 'volume_size': 1}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2059040488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79006f8e-8996-4e26-be89-948e24a77d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:39Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Creating volume 79006f8e-8996-4e26-be89-948e24a77d5e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:53:38 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:53:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:38 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e 1073741824
Nov 05 18:53:38 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:39 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e 1073741824" returned: 0 in 0.520s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:39 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e
Nov 05 18:53:39 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:39 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e" returned: 0 in 0.262s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:53:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24187a3a-01a0-4ef9-84e1-632d7338a603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79006f8e-8996-4e26-be89-948e24a77d5e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f63d1d-ae8d-44ff-9543-a6b80e628a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:39 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Volume volume-79006f8e-8996-4e26-be89-948e24a77d5e (79006f8e-8996-4e26-be89-948e24a77d5e): created successfully
Nov 05 18:53:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f63d1d-ae8d-44ff-9543-a6b80e628a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (ae38b9d1-d862-448b-a17f-86ace238ac51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:39 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ef1f2591-3cad-4744-9dbe-fa53b6de8572 tempest-ProjectMemberTests-1907350922 None] Created volume successfully.
Nov 05 18:53:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Creating offline snapshot 06d8d8b1-2293-43b1-8009-2c501e5c0229 of volume 79006f8e-8996-4e26-be89-948e24a77d5e {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:53:41 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f40422-a527-4276-95b2-5ecc1cc56d72]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:41 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e
Nov 05 18:53:41 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:41 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e" returned: 0 in 0.407s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:41 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229 1G
Nov 05 18:53:41 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:41 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229 1G" returned: 0 in 0.485s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79006f8e-8996-4e26-be89-948e24a77d5e -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:41 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79006f8e-8996-4e26-be89-948e24a77d5e -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229
Nov 05 18:53:41 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Flow 'volume_create_manager' (901814a3-8b3a-4694-9d03-25a95e1e7498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1828a736-4f75-4046-97e0-760440436f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:42 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1828a736-4f75-4046-97e0-760440436f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1395497949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dc5e3f-75f2-4302-be20-5da79a0b4c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024fb92c649543c085d45d8785f46afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:42Z,use_quota=True,user_id='619810a7fee248fbb6e64e76410c5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ea0ede-5ebd-4a1c-9a4d-9d550603958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ea0ede-5ebd-4a1c-9a4d-9d550603958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b527ddcc-66bf-4bed-a29b-b0b18877ce75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b527ddcc-66bf-4bed-a29b-b0b18877ce75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5dc5e3f-75f2-4302-be20-5da79a0b4c3b', 'volume_name': 'volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c70ff7-4986-4f37-8139-f87a1c8678c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c70ff7-4986-4f37-8139-f87a1c8678c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add458e5-1633-4745-a1b1-c8ef2eeb5152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:42 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Volume d5dc5e3f-75f2-4302-be20-5da79a0b4c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b', 'volume_size': 1}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79006f8e-8996-4e26-be89-948e24a77d5e -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229" returned: 0 in 0.440s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:42 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229 is being set with open permissions: ugo+rw
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:42 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229
Nov 05 18:53:42 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:42 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229" returned: 0 in 0.263s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:42 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.info
Nov 05 18:53:42 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:42 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.info" returned: 0 in 0.310s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:42 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.info is being set with open permissions: ugo+rw
Nov 05 18:53:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:42 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.info
Nov 05 18:53:42 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:43 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.info" returned: 0 in 0.265s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.899s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1395497949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dc5e3f-75f2-4302-be20-5da79a0b4c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024fb92c649543c085d45d8785f46afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:42Z,use_quota=True,user_id='619810a7fee248fbb6e64e76410c5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Creating volume d5dc5e3f-75f2-4302-be20-5da79a0b4c3b {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:53:43 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:43 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b 1073741824
Nov 05 18:53:43 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:43 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fe993205-c4d9-4ced-b4dd-ef1fb53891f5 tempest-ProjectMemberTests-1907350922 None] Create snapshot completed successfully
Nov 05 18:53:43 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b 1073741824" returned: 0 in 0.487s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:43 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b
Nov 05 18:53:43 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:44 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" returned: 0 in 0.253s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add458e5-1633-4745-a1b1-c8ef2eeb5152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0951543d-adce-4faf-a4db-436196f8622b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:44 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Volume volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b (d5dc5e3f-75f2-4302-be20-5da79a0b4c3b): created successfully
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0951543d-adce-4faf-a4db-436196f8622b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Flow 'volume_create_manager' (901814a3-8b3a-4694-9d03-25a95e1e7498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8d56662d-1266-49ef-9d71-f3a985b4a200 tempest-SnapshotDependencyTests-1260197258 None] Created volume successfully.
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-06d8d8b1-2293-43b1-8009-2c501e5c0229-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-06d8d8b1-2293-43b1-8009-2c501e5c0229-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-79006f8e-8996-4e26-be89-948e24a77d5e" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-79006f8e-8996-4e26-be89-948e24a77d5e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-06d8d8b1-2293-43b1-8009-2c501e5c0229" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-06d8d8b1-2293-43b1-8009-2c501e5c0229" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Deleting offline snapshot 06d8d8b1-2293-43b1-8009-2c501e5c0229 of volume 79006f8e-8996-4e26-be89-948e24a77d5e {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] snapshot_file for this snap is: volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbc889f-1074-4009-a353-09390249f8c3]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:44 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229
Nov 05 18:53:44 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Creating offline snapshot 1662dabc-6076-4f34-80ff-11fb07bbc103 of volume d5dc5e3f-75f2-4302-be20-5da79a0b4c3b {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[39297611-7273-4434-80dd-acc01679ca42]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:44 devstack sudo[107209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b
Nov 05 18:53:44 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:44 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229" returned: 0 in 0.404s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79006f8e-8996-4e26-be89-948e24a77d5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6fa230-aaf7-4d2b-b351-c022b28d0baf]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:44 devstack sudo[107214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e
Nov 05 18:53:44 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:44 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" returned: 0 in 0.372s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:44 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 1G
Nov 05 18:53:44 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:45 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:45 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229
Nov 05 18:53:45 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:45 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 1G" returned: 0 in 0.462s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:45 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103
Nov 05 18:53:45 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:45 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229" returned: 0 in 0.394s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:45 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229
Nov 05 18:53:45 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:45 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103" returned: 0 in 0.308s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:45 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 is being set with open permissions: ugo+rw
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:45 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103
Nov 05 18:53:45 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:45 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e.06d8d8b1-2293-43b1-8009-2c501e5c0229" returned: 0 in 0.294s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-06d8d8b1-2293-43b1-8009-2c501e5c0229" released by "_delete_snapshot" :: held 1.569s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-79006f8e-8996-4e26-be89-948e24a77d5e" released by "delete_snapshot" :: held 1.599s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:45 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103" returned: 0 in 0.252s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Created reservations ['7e4f9193-cf99-4837-ae59-3552a5dcddc7', '3a859a45-c7d3-4c78-8e62-4f27bb4e223e', '3be0ad7c-64f8-47b6-b383-6618aabf3fda', '4862ef6b-3910-4151-a2d3-b7195ac120ef'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:46 devstack sudo[107250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.info
Nov 05 18:53:46 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Delete snapshot completed successfully.
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c38ee2c5-9b0c-430d-969c-838f79315928 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-06d8d8b1-2293-43b1-8009-2c501e5c0229-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:46 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.info" returned: 0 in 0.252s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:46 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.info is being set with open permissions: ugo+rw
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:46 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.info
Nov 05 18:53:46 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-79006f8e-8996-4e26-be89-948e24a77d5e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-79006f8e-8996-4e26-be89-948e24a77d5e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-79006f8e-8996-4e26-be89-948e24a77d5e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-79006f8e-8996-4e26-be89-948e24a77d5e" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[70abe47f-3493-49c1-9767-fc757a5887c4]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:46 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.info" returned: 0 in 0.270s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:46 devstack sudo[107255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e
Nov 05 18:53:46 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:46 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-37447c65-16d4-499d-bf94-1ff15f510849 tempest-SnapshotDependencyTests-1260197258 None] Create snapshot completed successfully
Nov 05 18:53:46 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:46 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e
Nov 05 18:53:46 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:47 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-79006f8e-8996-4e26-be89-948e24a77d5e" returned: 0 in 0.258s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-79006f8e-8996-4e26-be89-948e24a77d5e" released by "delete_volume" :: held 0.683s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Created reservations ['66f8df22-46e7-4eee-9546-eac8406fb9f3', 'bab4e6a6-d9d3-4cd2-bf25-766445e5b902', '112fd261-d5f5-4e32-973e-001604a7bea7', '3057cb68-a02f-40bc-9d70-3ad511804630'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:47 devstack sudo[107264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:53:47 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:47 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.256s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:53:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Deleted volume successfully.
Nov 05 18:53:47 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-e6f852f4-4c2a-4af5-bd56-e2e928f998d1 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-79006f8e-8996-4e26-be89-948e24a77d5e-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (1fbec55f-a691-4fed-b4e2-a6805a5cff5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125c3521-139c-443d-ad9e-28fa95881b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (125c3521-139c-443d-ad9e-28fa95881b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903240480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034559b3-4907-4770-ab51-d0dfa701ec0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:48Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0afd6e7-f9d7-444c-ba7f-244524eac306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0afd6e7-f9d7-444c-ba7f-244524eac306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb4f3d1-3149-4878-8db5-75b8cb26549b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb4f3d1-3149-4878-8db5-75b8cb26549b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034559b3-4907-4770-ab51-d0dfa701ec0a', 'volume_name': 'volume-034559b3-4907-4770-ab51-d0dfa701ec0a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc01829-d15e-432d-af34-2ad204800b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc01829-d15e-432d-af34-2ad204800b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3609cc3-9131-4709-933d-fd54efd44c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Volume 034559b3-4907-4770-ab51-d0dfa701ec0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034559b3-4907-4770-ab51-d0dfa701ec0a', 'volume_size': 1}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903240480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034559b3-4907-4770-ab51-d0dfa701ec0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:48Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Creating volume 034559b3-4907-4770-ab51-d0dfa701ec0a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:53:48 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:48 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a 1073741824
Nov 05 18:53:48 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Flow 'volume_create_manager' (31d710c6-a309-43d1-aff2-1af49b7690d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a845775-d7db-46bc-84e9-f6ade0c59c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a845775-d7db-46bc-84e9-f6ade0c59c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f890e645-95f7-4585-8d03-108391c366aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024fb92c649543c085d45d8785f46afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1662dabc-6076-4f34-80ff-11fb07bbc103,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:53:48Z,use_quota=True,user_id='619810a7fee248fbb6e64e76410c5771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da368e26-cd24-4839-996a-80024d5d1702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da368e26-cd24-4839-996a-80024d5d1702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b710ab-65d8-4f88-9df1-f33a18636c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b710ab-65d8-4f88-9df1-f33a18636c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f890e645-95f7-4585-8d03-108391c366aa', 'volume_name': 'volume-f890e645-95f7-4585-8d03-108391c366aa', 'volume_size': 1, 'snapshot_id': '1662dabc-6076-4f34-80ff-11fb07bbc103'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d07591-d1c4-4e3e-9d6e-50657d778c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d07591-d1c4-4e3e-9d6e-50657d778c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a861d615-1af4-4c57-8f10-eb2676f30d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Volume f890e645-95f7-4585-8d03-108391c366aa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f890e645-95f7-4585-8d03-108391c366aa', 'volume_size': 1, 'snapshot_id': '1662dabc-6076-4f34-80ff-11fb07bbc103'}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:48 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a 1073741824" returned: 0 in 0.431s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:48 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a
Nov 05 18:53:48 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:48 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a" returned: 0 in 0.244s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.432s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "cinder-quobyte-1662dabc-6076-4f34-80ff-11fb07bbc103-f890e645-95f7-4585-8d03-108391c366aa" by "_create_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3609cc3-9131-4709-933d-fd54efd44c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034559b3-4907-4770-ab51-d0dfa701ec0a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3574e543-42fc-427c-9c4e-c8e645a2f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-1662dabc-6076-4f34-80ff-11fb07bbc103-f890e645-95f7-4585-8d03-108391c366aa" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Creating volume f890e645-95f7-4585-8d03-108391c366aa from snapshot 1662dabc-6076-4f34-80ff-11fb07bbc103 {{(pid=87086) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "cinder-quobyte-f890e645-95f7-4585-8d03-108391c366aa" by "_copy_volume_from_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:48 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Volume volume-034559b3-4907-4770-ab51-d0dfa701ec0a (034559b3-4907-4770-ab51-d0dfa701ec0a): created successfully
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3574e543-42fc-427c-9c4e-c8e645a2f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (1fbec55f-a691-4fed-b4e2-a6805a5cff5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-f890e645-95f7-4585-8d03-108391c366aa" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:48 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] snapshot: 1662dabc-6076-4f34-80ff-11fb07bbc103, volume: f890e645-95f7-4585-8d03-108391c366aa,  {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 18:53:48 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b71d62bc-71ae-49bf-9188-7ef3b081b291 tempest-ProjectMemberTests-1907350922 None] Created volume successfully.
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d501a-f20f-438a-855e-82e4d3124dd8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:49 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103
Nov 05 18:53:49 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:49 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103" returned: 0 in 0.419s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f6752-2e3e-478a-8d3e-c9d6d6704a7d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:49 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b
Nov 05 18:53:49 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:49 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" returned: 0 in 0.358s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Creating direct copy from snapshot {{(pid=87086) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG cinder.utils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Path /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa not found in is_blk_device check {{(pid=87086) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 05 18:53:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:49 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa
Nov 05 18:53:49 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:55 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa" returned: 0 in 5.591s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG cinder.image.image_utils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Image conversion details: src /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa {{(pid=87086) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 18:53:55 devstack cinder-volume[87086]: INFO cinder.image.image_utils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Converted 1024.00 MB image at 183.10 MB/s
Nov 05 18:53:55 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa is being set with open permissions: ugo+rw
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:55 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa
Nov 05 18:53:55 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:55 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa" returned: 0 in 0.235s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-f890e645-95f7-4585-8d03-108391c366aa" released by "_copy_volume_from_snapshot" :: held 6.710s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-1662dabc-6076-4f34-80ff-11fb07bbc103-f890e645-95f7-4585-8d03-108391c366aa" released by "_create_volume_from_snapshot" :: held 6.787s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.820s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.449s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Creating offline snapshot 04bf8209-4c70-45f3-a8cd-2bc122efd72e of volume 034559b3-4907-4770-ab51-d0dfa701ec0a {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a861d615-1af4-4c57-8f10-eb2676f30d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f890e645-95f7-4585-8d03-108391c366aa', 'volume_size': 1, 'snapshot_id': '1662dabc-6076-4f34-80ff-11fb07bbc103'}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0ad1f2-0deb-40c7-a1b5-e2e080fd9ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4115a9f0-4ee2-4427-946f-145aad378f3d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:55 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Volume volume-f890e645-95f7-4585-8d03-108391c366aa (f890e645-95f7-4585-8d03-108391c366aa): created successfully
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0ad1f2-0deb-40c7-a1b5-e2e080fd9ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:53:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Flow 'volume_create_manager' (31d710c6-a309-43d1-aff2-1af49b7690d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:53:55 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8e019e54-17a8-44e3-8724-fc6e768008e5 tempest-SnapshotDependencyTests-1260197258 None] Created volume successfully.
Nov 05 18:53:55 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a
Nov 05 18:53:55 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "cinder-1662dabc-6076-4f34-80ff-11fb07bbc103-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-1662dabc-6076-4f34-80ff-11fb07bbc103-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "cinder-quobyte-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "cinder-quobyte-1662dabc-6076-4f34-80ff-11fb07bbc103" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-1662dabc-6076-4f34-80ff-11fb07bbc103" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Deleting offline snapshot 1662dabc-6076-4f34-80ff-11fb07bbc103 of volume d5dc5e3f-75f2-4302-be20-5da79a0b4c3b {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] snapshot_file for this snap is: volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8914a888-b2ad-4592-8312-dde0c7926933]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:56 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a" returned: 0 in 0.381s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:56 devstack sudo[107347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e 1G
Nov 05 18:53:56 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:56 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103
Nov 05 18:53:56 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:56 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103" returned: 0 in 0.410s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2ccc85-52dd-4091-9d30-6a18471994ea]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:56 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e 1G" returned: 0 in 0.438s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034559b3-4907-4770-ab51-d0dfa701ec0a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:56 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034559b3-4907-4770-ab51-d0dfa701ec0a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e
Nov 05 18:53:56 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:56 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b
Nov 05 18:53:56 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:56 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-034559b3-4907-4770-ab51-d0dfa701ec0a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e" returned: 0 in 0.303s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:56 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e is being set with open permissions: ugo+rw
Nov 05 18:53:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:56 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e
Nov 05 18:53:56 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:57 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" returned: 0 in 0.551s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:57 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e" returned: 0 in 0.257s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:57 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103
Nov 05 18:53:57 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:57 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.info
Nov 05 18:53:57 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:57 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.info" returned: 0 in 0.290s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:57 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.info is being set with open permissions: ugo+rw
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:57 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103" returned: 0 in 0.352s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:57 devstack sudo[107378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.info
Nov 05 18:53:57 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:57 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103
Nov 05 18:53:57 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:57 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.info" returned: 0 in 0.249s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:57 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b.1662dabc-6076-4f34-80ff-11fb07bbc103" returned: 0 in 0.262s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-1662dabc-6076-4f34-80ff-11fb07bbc103" released by "_delete_snapshot" :: held 1.701s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:57 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-8128ba97-e211-47e9-a748-4f354687ed40 tempest-ProjectMemberTests-1907350922 None] Create snapshot completed successfully
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" released by "delete_snapshot" :: held 1.725s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Created reservations ['97ece1f6-bce0-4d10-bb89-2becbe539067', 'de0ffd50-ef21-4687-b395-30f001f83421', 'a214de4f-c58c-4bdd-9ea2-80337937c339', '9dc02501-407c-4be4-9b00-a24b9a9c25cc'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:57 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Delete snapshot completed successfully.
Nov 05 18:53:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bc0f3d52-076e-4401-acc4-0a00cb0ad9a8 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-1662dabc-6076-4f34-80ff-11fb07bbc103-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "cinder-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "cinder-quobyte-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf88d21-8999-4f81-80d1-a93f1a9634fa]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:58 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b
Nov 05 18:53:58 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:58 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" returned: 0 in 0.368s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:58 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b
Nov 05 18:53:58 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-04bf8209-4c70-45f3-a8cd-2bc122efd72e-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Lock "cinder-04bf8209-4c70-45f3-a8cd-2bc122efd72e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-034559b3-4907-4770-ab51-d0dfa701ec0a" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-034559b3-4907-4770-ab51-d0dfa701ec0a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-04bf8209-4c70-45f3-a8cd-2bc122efd72e" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-04bf8209-4c70-45f3-a8cd-2bc122efd72e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Deleting offline snapshot 04bf8209-4c70-45f3-a8cd-2bc122efd72e of volume 034559b3-4907-4770-ab51-d0dfa701ec0a {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] snapshot_file for this snap is: volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379f06c-d45e-479e-9377-7dbdda62bef7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:58 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" returned: 0 in 0.274s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:58 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e
Nov 05 18:53:58 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:58 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b" released by "delete_volume" :: held 0.709s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Created reservations ['d70a068b-8031-4165-a7b7-4193a60223b3', '0a8b7953-b509-4208-92a8-e3acdbb9ad95', '91571155-1a8c-4e33-ae0b-dd3423480b16', 'ce070248-19a1-409e-aa6c-6afbb1f49c19'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:59 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:53:59 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:59 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e" returned: 0 in 0.473s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-034559b3-4907-4770-ab51-d0dfa701ec0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81f8f47-de83-4165-8404-d0b597799b0d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:59 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.316s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:53:59 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Deleted volume successfully.
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "cinder-f890e645-95f7-4585-8d03-108391c366aa-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-9fa7c120-5171-4fe9-90df-4d417ab6c186 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-d5dc5e3f-75f2-4302-be20-5da79a0b4c3b-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-f890e645-95f7-4585-8d03-108391c366aa-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:59 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a
Nov 05 18:53:59 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "cinder-quobyte-f890e645-95f7-4585-8d03-108391c366aa" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-f890e645-95f7-4585-8d03-108391c366aa" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58672d5-1b0c-423f-9765-57b503a46d1d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:59 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa
Nov 05 18:53:59 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:59 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a" returned: 0 in 0.489s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:53:59 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e
Nov 05 18:53:59 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:53:59 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa" returned: 0 in 0.375s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:53:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:00 devstack sudo[107412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa
Nov 05 18:54:00 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:00 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e" returned: 0 in 0.366s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:00 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f890e645-95f7-4585-8d03-108391c366aa" returned: 0 in 0.268s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:00 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e
Nov 05 18:54:00 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-quobyte-f890e645-95f7-4585-8d03-108391c366aa" released by "delete_volume" :: held 0.689s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Created reservations ['6ae394e4-0d64-420d-be60-c56ba2364508', '18b4463d-45ac-4f88-b911-f39905407982', 'ade4f52f-34a1-41ef-9d22-721d2e739260', 'a2522734-11f2-4663-ba4d-2819b8f52a33'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:00 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:54:00 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:00 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a.04bf8209-4c70-45f3-a8cd-2bc122efd72e" returned: 0 in 0.323s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-04bf8209-4c70-45f3-a8cd-2bc122efd72e" released by "_delete_snapshot" :: held 1.802s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-034559b3-4907-4770-ab51-d0dfa701ec0a" released by "delete_snapshot" :: held 1.837s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Created reservations ['ce669fe4-d97f-43b2-b8ec-c2c33533d05d', '6cad1871-6845-4ac9-85b7-2cfd9c255ad7', 'f487f1d6-07c1-46a7-a774-96018693102e', '828a705a-f7c9-4785-ac49-65cc85106d22'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:00 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.330s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:54:00 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Deleted volume successfully.
Nov 05 18:54:00 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Delete snapshot completed successfully.
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-c037ab8c-54ab-4171-a660-a09188565831 tempest-SnapshotDependencyTests-1260197258 None] Lock "cinder-f890e645-95f7-4585-8d03-108391c366aa-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e585fc0-db17-4c57-8de4-5086e08de2ce tempest-ProjectMemberTests-1907350922 None] Lock "cinder-04bf8209-4c70-45f3-a8cd-2bc122efd72e-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-034559b3-4907-4770-ab51-d0dfa701ec0a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Lock "cinder-034559b3-4907-4770-ab51-d0dfa701ec0a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-034559b3-4907-4770-ab51-d0dfa701ec0a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-034559b3-4907-4770-ab51-d0dfa701ec0a" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:01 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3135cb48-78a8-4aed-8c1d-80c882736c33]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:01 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a
Nov 05 18:54:01 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:01 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a" returned: 0 in 0.433s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:01 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a
Nov 05 18:54:01 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:01 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-034559b3-4907-4770-ab51-d0dfa701ec0a" returned: 0 in 0.313s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-034559b3-4907-4770-ab51-d0dfa701ec0a" released by "delete_volume" :: held 0.836s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:01 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Created reservations ['14cf99f5-56f8-4ef4-9290-06420a354b98', 'ae309254-e9d7-445c-8dc2-b4c6169d4407', 'd346f4ec-2c59-4036-83b1-affac5a891ba', '7ddd55fd-7449-4dd5-93fb-9a7727103083'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:02 devstack sudo[107437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:54:02 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:02 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.298s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:54:02 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Deleted volume successfully.
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cddbc7ae-dd48-461d-98e3-04dc33bffe2f tempest-ProjectMemberTests-1907350922 None] Lock "cinder-034559b3-4907-4770-ab51-d0dfa701ec0a-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (89ead740-a856-4dcb-9b7d-28cd5d0cedcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f207b2a-9d05-4efd-9e29-f18014557b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f207b2a-9d05-4efd-9e29-f18014557b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374048615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42293427-389b-4169-9297-13cbf4112498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:03Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5479874e-8db6-430e-bd4b-1fcb6251ff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5479874e-8db6-430e-bd4b-1fcb6251ff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a72799d-300f-4ea6-bd27-b3ec4abde134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a72799d-300f-4ea6-bd27-b3ec4abde134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42293427-389b-4169-9297-13cbf4112498', 'volume_name': 'volume-42293427-389b-4169-9297-13cbf4112498', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf9b7a1-4250-4e98-b9fa-f6f37acdf6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf9b7a1-4250-4e98-b9fa-f6f37acdf6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bfa56a-6335-4904-8bae-64834016b1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Volume 42293427-389b-4169-9297-13cbf4112498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42293427-389b-4169-9297-13cbf4112498', 'volume_size': 1}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374048615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42293427-389b-4169-9297-13cbf4112498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:03Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Creating volume 42293427-389b-4169-9297-13cbf4112498 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:54:02 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:54:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:02 devstack sudo[107441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498 1073741824
Nov 05 18:54:02 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:03 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498 1073741824" returned: 0 in 0.508s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:03 devstack sudo[107447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498
Nov 05 18:54:03 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:03 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498" returned: 0 in 0.267s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:03 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:54:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25bfa56a-6335-4904-8bae-64834016b1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42293427-389b-4169-9297-13cbf4112498', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691a7a6e-838a-42df-8249-bb6314a5275c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:03 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Volume volume-42293427-389b-4169-9297-13cbf4112498 (42293427-389b-4169-9297-13cbf4112498): created successfully
Nov 05 18:54:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691a7a6e-838a-42df-8249-bb6314a5275c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:03 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (89ead740-a856-4dcb-9b7d-28cd5d0cedcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:03 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-9cf57afc-f979-4e4f-a3ca-3f0c3e1fe705 tempest-ProjectMemberTests-1907350922 None] Created volume successfully.
Nov 05 18:54:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Creating offline snapshot 1935f3e4-df04-4fc7-9a78-74d726bdd07a of volume 42293427-389b-4169-9297-13cbf4112498 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:54:04 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a75787-ba34-4020-b761-5240a4ceb216]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:05 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498
Nov 05 18:54:05 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:05 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498" returned: 0 in 0.404s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:05 devstack sudo[107456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a 1G
Nov 05 18:54:05 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:06 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a 1G" returned: 0 in 0.627s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42293427-389b-4169-9297-13cbf4112498 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:06 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42293427-389b-4169-9297-13cbf4112498 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a
Nov 05 18:54:06 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:06 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42293427-389b-4169-9297-13cbf4112498 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a" returned: 0 in 0.342s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:06 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a is being set with open permissions: ugo+rw
Nov 05 18:54:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:06 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a
Nov 05 18:54:06 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:06 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a" returned: 0 in 0.272s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:06 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.info
Nov 05 18:54:06 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:06 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.info" returned: 0 in 0.270s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:06 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.info is being set with open permissions: ugo+rw
Nov 05 18:54:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:06 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.info
Nov 05 18:54:06 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:07 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.info" returned: 0 in 0.302s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:07 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1c995df5-a589-4ab1-b470-722db35dfaa8 tempest-ProjectMemberTests-1907350922 None] Create snapshot completed successfully
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-1935f3e4-df04-4fc7-9a78-74d726bdd07a-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-1935f3e4-df04-4fc7-9a78-74d726bdd07a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-42293427-389b-4169-9297-13cbf4112498" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-42293427-389b-4169-9297-13cbf4112498" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-1935f3e4-df04-4fc7-9a78-74d726bdd07a" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-1935f3e4-df04-4fc7-9a78-74d726bdd07a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Deleting offline snapshot 1935f3e4-df04-4fc7-9a78-74d726bdd07a of volume 42293427-389b-4169-9297-13cbf4112498 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] snapshot_file for this snap is: volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aae94b-6e65-462d-ba48-f9c62307456e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:08 devstack sudo[107479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a
Nov 05 18:54:08 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:08 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a" returned: 0 in 0.443s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42293427-389b-4169-9297-13cbf4112498(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e520cfb-197a-4e1b-8e89-edcdccb06157]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:08 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498
Nov 05 18:54:08 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:09 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498" returned: 0 in 0.375s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:09 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a
Nov 05 18:54:09 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:09 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a" returned: 0 in 0.477s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:09 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a
Nov 05 18:54:09 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:09 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:09 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498.1935f3e4-df04-4fc7-9a78-74d726bdd07a" returned: 0 in 0.265s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:09 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-1935f3e4-df04-4fc7-9a78-74d726bdd07a" released by "_delete_snapshot" :: held 1.693s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:09 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-42293427-389b-4169-9297-13cbf4112498" released by "delete_snapshot" :: held 1.720s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:09 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Created reservations ['d7cc6521-875e-4031-a8f6-723940059606', '42765149-b6e3-43ea-9dd0-0dff935def94', '12803d3b-2326-4dc6-990e-b66162f02653', '659584c3-8c16-47f0-9afd-ae7ffe46855b'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:10 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Delete snapshot completed successfully.
Nov 05 18:54:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b62c6b14-1cb8-42af-a567-3d99820b62b3 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-1935f3e4-df04-4fc7-9a78-74d726bdd07a-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-42293427-389b-4169-9297-13cbf4112498-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-42293427-389b-4169-9297-13cbf4112498-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-42293427-389b-4169-9297-13cbf4112498" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:10 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-42293427-389b-4169-9297-13cbf4112498" acquired by "delete_volume" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:10 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[24689850-4342-47e9-83b5-4dd85ccfbfb6]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:10 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498
Nov 05 18:54:10 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:10 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498" returned: 0 in 0.429s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:10 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:10 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498
Nov 05 18:54:10 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:11 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-42293427-389b-4169-9297-13cbf4112498" returned: 0 in 0.259s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-42293427-389b-4169-9297-13cbf4112498" released by "delete_volume" :: held 0.796s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=143,cinder:SELECT=109,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=104,cinder:INSERT=47,cinder:UPDATE=122,cinder:DELETE=11 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Created reservations ['0d292e03-eec8-4acc-969b-8edd8aa39f0d', 'd33d26bc-8e66-4a8a-bcc3-3eeea093ac50', 'c89be6bd-080e-4ede-9972-35ba1f34aa8c', '4ef952ae-6605-4c06-a94f-98931f15760d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:11 devstack sudo[107506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:54:11 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:11 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.361s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:54:11 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Deleted volume successfully.
Nov 05 18:54:11 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-27bbc4e7-2bca-4c4e-a957-87065a2b8595 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-42293427-389b-4169-9297-13cbf4112498-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (413a4cfe-e1ca-4284-8953-74a190556eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2491afc-3510-4c68-b417-6ad7fcc3cc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2491afc-3510-4c68-b417-6ad7fcc3cc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127416842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d371bca1-b562-425d-bed4-33ce80f6d00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:12Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d790126a-5c2c-45a5-b874-b15d561e0d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d790126a-5c2c-45a5-b874-b15d561e0d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a88f7d-b944-40e5-890c-866339335fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a88f7d-b944-40e5-890c-866339335fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd371bca1-b562-425d-bed4-33ce80f6d00a', 'volume_name': 'volume-d371bca1-b562-425d-bed4-33ce80f6d00a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809333d7-8653-4d3c-8bc8-72567096ec77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (809333d7-8653-4d3c-8bc8-72567096ec77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ba17a5-a44c-4d66-aa90-6d89c1e0bb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:12 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Volume d371bca1-b562-425d-bed4-33ce80f6d00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d371bca1-b562-425d-bed4-33ce80f6d00a', 'volume_size': 1}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127416842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d371bca1-b562-425d-bed4-33ce80f6d00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:12Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Creating volume d371bca1-b562-425d-bed4-33ce80f6d00a {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:54:12 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:12 devstack sudo[107509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a 1073741824
Nov 05 18:54:12 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:12 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a 1073741824" returned: 0 in 0.481s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:12 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a
Nov 05 18:54:12 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:12 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28ba17a5-a44c-4d66-aa90-6d89c1e0bb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d371bca1-b562-425d-bed4-33ce80f6d00a', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c95d7e9-4540-42d8-b48a-1a7c7ff15a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:13 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Volume volume-d371bca1-b562-425d-bed4-33ce80f6d00a (d371bca1-b562-425d-bed4-33ce80f6d00a): created successfully
Nov 05 18:54:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c95d7e9-4540-42d8-b48a-1a7c7ff15a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (413a4cfe-e1ca-4284-8953-74a190556eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:13 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a40e4857-e047-419b-8d9a-5abe92c9cb2f tempest-ProjectMemberTests-1907350922 None] Created volume successfully.
Nov 05 18:54:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Creating offline snapshot cc566ae8-1aba-4a76-8cab-969703f9df19 of volume d371bca1-b562-425d-bed4-33ce80f6d00a {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:54:14 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b8995-a16d-4bee-a049-615746ec2e5e]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:14 devstack sudo[107518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a
Nov 05 18:54:14 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:14 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a" returned: 0 in 0.371s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:14 devstack sudo[107523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19 1G
Nov 05 18:54:14 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:15 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19 1G" returned: 0 in 0.393s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d371bca1-b562-425d-bed4-33ce80f6d00a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:15 devstack sudo[107529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d371bca1-b562-425d-bed4-33ce80f6d00a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19
Nov 05 18:54:15 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:15 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d371bca1-b562-425d-bed4-33ce80f6d00a -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19" returned: 0 in 0.317s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:15 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19 is being set with open permissions: ugo+rw
Nov 05 18:54:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:15 devstack sudo[107534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19
Nov 05 18:54:15 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:15 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19" returned: 0 in 0.240s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:15 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.info
Nov 05 18:54:15 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:15 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.info" returned: 0 in 0.265s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:15 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.info is being set with open permissions: ugo+rw
Nov 05 18:54:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:16 devstack sudo[107541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.info
Nov 05 18:54:16 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:16 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.info" returned: 0 in 0.234s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:16 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fe42990a-16c9-4ad1-b456-7e40102f1b56 tempest-ProjectMemberTests-1907350922 None] Create snapshot completed successfully
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-cc566ae8-1aba-4a76-8cab-969703f9df19-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-cc566ae8-1aba-4a76-8cab-969703f9df19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-d371bca1-b562-425d-bed4-33ce80f6d00a" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-d371bca1-b562-425d-bed4-33ce80f6d00a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-cc566ae8-1aba-4a76-8cab-969703f9df19" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-cc566ae8-1aba-4a76-8cab-969703f9df19" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Deleting offline snapshot cc566ae8-1aba-4a76-8cab-969703f9df19 of volume d371bca1-b562-425d-bed4-33ce80f6d00a {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] snapshot_file for this snap is: volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[17486909-f3ec-499c-ac44-78dd9938c039]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:16 devstack sudo[107544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19
Nov 05 18:54:16 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:16 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19" returned: 0 in 0.380s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d371bca1-b562-425d-bed4-33ce80f6d00a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:54:17 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[484a42d7-107f-4e78-8623-c2386a10f966]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:17 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a
Nov 05 18:54:17 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:17 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a" returned: 0 in 0.435s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:17 devstack sudo[107555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19
Nov 05 18:54:17 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:17 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19" returned: 0 in 0.355s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:17 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19
Nov 05 18:54:17 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:18 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a.cc566ae8-1aba-4a76-8cab-969703f9df19" returned: 0 in 0.245s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-cc566ae8-1aba-4a76-8cab-969703f9df19" released by "_delete_snapshot" :: held 1.529s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-d371bca1-b562-425d-bed4-33ce80f6d00a" released by "delete_snapshot" :: held 1.552s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Created reservations ['11431024-e55b-4e93-90f7-7ca7801cb6e2', '86e8068d-c019-4040-afa7-f26751409881', 'efc0de1e-e6fa-413f-94ea-638ec86bc56c', 'c52dbf68-c35b-4ead-98d2-684dfef6b41a'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:18 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Delete snapshot completed successfully.
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-17628c8f-3518-4448-b6e7-102a28649083 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-cc566ae8-1aba-4a76-8cab-969703f9df19-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-d371bca1-b562-425d-bed4-33ce80f6d00a-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Lock "cinder-d371bca1-b562-425d-bed4-33ce80f6d00a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-d371bca1-b562-425d-bed4-33ce80f6d00a" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-d371bca1-b562-425d-bed4-33ce80f6d00a" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89f70c4-a3c5-466b-b07f-c39a025c4012]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:18 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:18 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a
Nov 05 18:54:18 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:19 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a" returned: 0 in 0.376s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:19 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a
Nov 05 18:54:19 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:19 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-d371bca1-b562-425d-bed4-33ce80f6d00a" returned: 0 in 0.248s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-d371bca1-b562-425d-bed4-33ce80f6d00a" released by "delete_volume" :: held 0.699s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Created reservations ['f3b4eb06-0485-4ece-8a95-a1efaffc4012', '4f00be03-4147-4628-a6ab-e5ce9cf9b0ca', 'df82e98a-d3ee-4872-912e-2e6f4a4dcf11', 'f4c024d7-6e05-43ff-b3be-7c871541207d'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:19 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:54:19 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:19 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.282s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:54:19 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Deleted volume successfully.
Nov 05 18:54:19 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-480cd1e3-3770-44b3-9b57-a1c477fb450b tempest-ProjectMemberTests-1907350922 None] Lock "cinder-d371bca1-b562-425d-bed4-33ce80f6d00a-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (c01574ed-288e-4f01-8670-86c2d66b18ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7999c924-53e3-49b5-9965-90fd0afe9977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7999c924-53e3-49b5-9965-90fd0afe9977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163184089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535806ee-19c9-446e-bb54-46926e0a682d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:20Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a57ae30-082f-4706-9adb-31721f7385ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a57ae30-082f-4706-9adb-31721f7385ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda6dd17-f996-4221-ab2f-1b2570a032d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda6dd17-f996-4221-ab2f-1b2570a032d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535806ee-19c9-446e-bb54-46926e0a682d', 'volume_name': 'volume-535806ee-19c9-446e-bb54-46926e0a682d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a032a17d-cbc1-4048-afce-e3953610d5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a032a17d-cbc1-4048-afce-e3953610d5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26341c2b-71c1-42ff-baad-93a65bf2d2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:20 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Volume 535806ee-19c9-446e-bb54-46926e0a682d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535806ee-19c9-446e-bb54-46926e0a682d', 'volume_size': 1}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163184089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535806ee-19c9-446e-bb54-46926e0a682d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26530b79147c4031927079cc44e1f090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:20Z,use_quota=True,user_id='119e1115dcb74f05b4e5be07a8bf613b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Creating volume 535806ee-19c9-446e-bb54-46926e0a682d {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:54:20 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:20 devstack sudo[107574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d 1073741824
Nov 05 18:54:20 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:20 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d 1073741824" returned: 0 in 0.439s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:20 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d
Nov 05 18:54:20 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:21 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d" returned: 0 in 0.235s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26341c2b-71c1-42ff-baad-93a65bf2d2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535806ee-19c9-446e-bb54-46926e0a682d', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89661904-7ee7-4fda-a8be-92d46edc025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:21 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Volume volume-535806ee-19c9-446e-bb54-46926e0a682d (535806ee-19c9-446e-bb54-46926e0a682d): created successfully
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89661904-7ee7-4fda-a8be-92d46edc025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Flow 'volume_create_manager' (c01574ed-288e-4f01-8670-86c2d66b18ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d125e0ad-89b2-40ec-b848-c1b5f33f3d11 tempest-ProjectMemberTests-1907350922 None] Created volume successfully.
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Creating offline snapshot be4daaaa-293a-4444-b980-b6ed89e4f47c of volume 535806ee-19c9-446e-bb54-46926e0a682d {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1caff14-17da-44a5-97a0-e0d9e887d174]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:21 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d
Nov 05 18:54:21 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:21 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d" returned: 0 in 0.372s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:21 devstack sudo[107588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c 1G
Nov 05 18:54:21 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:22 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c 1G" returned: 0 in 0.397s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535806ee-19c9-446e-bb54-46926e0a682d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:22 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535806ee-19c9-446e-bb54-46926e0a682d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c
Nov 05 18:54:22 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:22 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-535806ee-19c9-446e-bb54-46926e0a682d -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c" returned: 0 in 0.307s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:22 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c is being set with open permissions: ugo+rw
Nov 05 18:54:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:22 devstack sudo[107599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c
Nov 05 18:54:22 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:22 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c" returned: 0 in 0.255s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:22 devstack sudo[107602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.info
Nov 05 18:54:22 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:23 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.info" returned: 0 in 0.278s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:23 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.info is being set with open permissions: ugo+rw
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:23 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.info
Nov 05 18:54:23 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:23 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.info" returned: 0 in 0.247s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:23 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2bc94fcf-dc7b-40c4-a688-26a0e8118888 tempest-ProjectMemberTests-1907350922 None] Create snapshot completed successfully
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-be4daaaa-293a-4444-b980-b6ed89e4f47c-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-be4daaaa-293a-4444-b980-b6ed89e4f47c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-535806ee-19c9-446e-bb54-46926e0a682d" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-535806ee-19c9-446e-bb54-46926e0a682d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-be4daaaa-293a-4444-b980-b6ed89e4f47c" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-be4daaaa-293a-4444-b980-b6ed89e4f47c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Deleting offline snapshot be4daaaa-293a-4444-b980-b6ed89e4f47c of volume 535806ee-19c9-446e-bb54-46926e0a682d {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] snapshot_file for this snap is: volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c49e5-72af-4f06-821d-1a9a311d4c14]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:24 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c
Nov 05 18:54:24 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:24 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c" returned: 0 in 0.355s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-535806ee-19c9-446e-bb54-46926e0a682d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:54:24 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d25ccaf-d4c6-4965-8236-b1da8615ca30]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:24 devstack sudo[107613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d
Nov 05 18:54:24 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:24 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d" returned: 0 in 0.364s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:24 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c
Nov 05 18:54:24 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:25 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c" returned: 0 in 0.344s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:25 devstack sudo[107623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c
Nov 05 18:54:25 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:25 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d.be4daaaa-293a-4444-b980-b6ed89e4f47c" returned: 0 in 0.239s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-be4daaaa-293a-4444-b980-b6ed89e4f47c" released by "_delete_snapshot" :: held 1.403s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-535806ee-19c9-446e-bb54-46926e0a682d" released by "delete_snapshot" :: held 1.425s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Created reservations ['91a461c1-3a10-4b9c-b176-98f5ee8b1e4c', '7289cfc1-5c59-4c88-a0ab-f1fcbcfac138', '17890d7c-bf3e-4da8-8fa8-e3a684d8f687', 'a386d226-576b-49af-810a-efd8072033b8'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:25 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Delete snapshot completed successfully.
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-b3a056ac-4ab9-47a1-879b-67e20af8d760 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-be4daaaa-293a-4444-b980-b6ed89e4f47c-delete_snapshot" released by "delete_snapshot" :: held 1.582s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:25 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:54:25 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:25 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.248s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:54:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-535806ee-19c9-446e-bb54-46926e0a682d-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-535806ee-19c9-446e-bb54-46926e0a682d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "cinder-quobyte-535806ee-19c9-446e-bb54-46926e0a682d" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-535806ee-19c9-446e-bb54-46926e0a682d" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47dc8ec-305e-462d-9ef6-5e0973749bca]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:26 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d
Nov 05 18:54:26 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:26 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d" returned: 0 in 0.382s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:26 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d
Nov 05 18:54:26 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:26 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-535806ee-19c9-446e-bb54-46926e0a682d" returned: 0 in 0.239s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-quobyte-535806ee-19c9-446e-bb54-46926e0a682d" released by "delete_volume" :: held 0.682s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Created reservations ['9452a68c-b10b-45d7-9bf6-7858c386dbcc', '42deac84-df9e-45d3-99d8-601cca98355c', 'c7bff939-5a29-46d6-9d1d-7615439cf100', '9841b2cb-65fd-44a4-9476-85243cb1625e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:26 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:54:26 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:27 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.255s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:27 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:54:27 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Deleted volume successfully.
Nov 05 18:54:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-5c8f4181-eb30-4d32-87f7-74cbe8285236 tempest-ProjectMemberTests-1907350922 None] Lock "cinder-535806ee-19c9-446e-bb54-46926e0a682d-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:30 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:54:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Flow 'volume_create_manager' (eedb8923-a1b7-4351-b0be-e9a183de6d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7844b03-6f32-48f8-861d-300fabde2c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7844b03-6f32-48f8-861d-300fabde2c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267443337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c32e948-bb75-42f0-9e0c-06d61fb8984b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745128d0c8584ac096ee302df93bd2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:31Z,use_quota=True,user_id='d8cc59d844b943d39ec13ff38d5ec4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bf7ac0-2294-46cb-9fba-bb77fc26682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bf7ac0-2294-46cb-9fba-bb77fc26682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3dca33d-5d2d-4f7a-8422-6892ec162d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3dca33d-5d2d-4f7a-8422-6892ec162d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c32e948-bb75-42f0-9e0c-06d61fb8984b', 'volume_name': 'volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ebb6dc-91ee-49e7-ba0a-e88887b15aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:30 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ebb6dc-91ee-49e7-ba0a-e88887b15aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9e4646-bf89-431e-88b2-fd2dc2d6699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:31 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Volume 9c32e948-bb75-42f0-9e0c-06d61fb8984b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b', 'volume_size': 1}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267443337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c32e948-bb75-42f0-9e0c-06d61fb8984b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745128d0c8584ac096ee302df93bd2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:31Z,use_quota=True,user_id='d8cc59d844b943d39ec13ff38d5ec4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Creating volume 9c32e948-bb75-42f0-9e0c-06d61fb8984b {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:54:31 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:31 devstack sudo[107642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b 1073741824
Nov 05 18:54:31 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:31 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b 1073741824" returned: 0 in 0.448s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:31 devstack sudo[107647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b
Nov 05 18:54:31 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:31 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b" returned: 0 in 0.275s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9e4646-bf89-431e-88b2-fd2dc2d6699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e1eba7-31ba-4464-b3ec-88c81b3592fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:31 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Volume volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b (9c32e948-bb75-42f0-9e0c-06d61fb8984b): created successfully
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e1eba7-31ba-4464-b3ec-88c81b3592fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:31 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Flow 'volume_create_manager' (eedb8923-a1b7-4351-b0be-e9a183de6d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:31 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-dc8097e5-4060-4807-b278-385913e439dc tempest-ProjectReaderTests-1695604257 None] Created volume successfully.
Nov 05 18:54:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:32 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Creating offline snapshot 61c75265-15f1-4c58-ac97-46e4baf51caa of volume 9c32e948-bb75-42f0-9e0c-06d61fb8984b {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:54:32 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe43ab58-58b8-43d2-9d2e-f582a01deb47]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:32 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b
Nov 05 18:54:32 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:32 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b" returned: 0 in 0.449s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:32 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:32 devstack sudo[107655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa 1G
Nov 05 18:54:32 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:33 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa 1G" returned: 0 in 0.432s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:33 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa
Nov 05 18:54:33 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:33 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa" returned: 0 in 0.309s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:33 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa is being set with open permissions: ugo+rw
Nov 05 18:54:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:33 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa
Nov 05 18:54:33 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:33 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa" returned: 0 in 0.257s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:33 devstack sudo[107668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.info
Nov 05 18:54:33 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:33 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.info" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:33 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.info is being set with open permissions: ugo+rw
Nov 05 18:54:33 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:33 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.info
Nov 05 18:54:33 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:34 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.info" returned: 0 in 0.263s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:34 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:34 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-cbf379b2-a254-4177-84d6-4ecc41e4e071 tempest-ProjectReaderTests-1695604257 None] Create snapshot completed successfully
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-61c75265-15f1-4c58-ac97-46e4baf51caa-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-61c75265-15f1-4c58-ac97-46e4baf51caa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-9c32e948-bb75-42f0-9e0c-06d61fb8984b" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-9c32e948-bb75-42f0-9e0c-06d61fb8984b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-61c75265-15f1-4c58-ac97-46e4baf51caa" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-61c75265-15f1-4c58-ac97-46e4baf51caa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Deleting offline snapshot 61c75265-15f1-4c58-ac97-46e4baf51caa of volume 9c32e948-bb75-42f0-9e0c-06d61fb8984b {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] snapshot_file for this snap is: volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d403e3-2942-4d20-b35c-19cb51c4897b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:35 devstack sudo[107675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa
Nov 05 18:54:35 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:35 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa" returned: 0 in 0.365s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6dd986-2c34-40e4-928d-b7a6dff53a3d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:35 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:36 devstack sudo[107681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b
Nov 05 18:54:36 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:36 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b" returned: 0 in 0.357s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:36 devstack sudo[107686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa
Nov 05 18:54:36 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:36 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa" returned: 0 in 0.335s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:36 devstack sudo[107691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa
Nov 05 18:54:36 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:36 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:36 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b.61c75265-15f1-4c58-ac97-46e4baf51caa" returned: 0 in 0.269s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-61c75265-15f1-4c58-ac97-46e4baf51caa" released by "_delete_snapshot" :: held 1.430s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:36 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-9c32e948-bb75-42f0-9e0c-06d61fb8984b" released by "delete_snapshot" :: held 1.451s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:37 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Created reservations ['0d229fb9-b812-455a-942f-a5ccb472cafa', 'b172cf56-a2df-4f1a-95a5-9e77da738b70', '1bcf429d-205c-421f-948f-a7edbd57f23b', 'ba7767d3-f42d-48d7-b706-cc7d101bc6ab'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:37 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Delete snapshot completed successfully.
Nov 05 18:54:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb05800c-2d7f-4fce-bf75-62800ca06009 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-61c75265-15f1-4c58-ac97-46e4baf51caa-delete_snapshot" released by "delete_snapshot" :: held 1.608s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-9c32e948-bb75-42f0-9e0c-06d61fb8984b-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Lock "cinder-9c32e948-bb75-42f0-9e0c-06d61fb8984b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-9c32e948-bb75-42f0-9e0c-06d61fb8984b" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:37 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-9c32e948-bb75-42f0-9e0c-06d61fb8984b" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:37 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdd7c01-f0a0-46df-953f-160af5be6efc]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:37 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:37 devstack sudo[107696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b
Nov 05 18:54:37 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:38 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b" returned: 0 in 0.430s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:38 devstack sudo[107701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b
Nov 05 18:54:38 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:38 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-9c32e948-bb75-42f0-9e0c-06d61fb8984b" returned: 0 in 0.275s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-9c32e948-bb75-42f0-9e0c-06d61fb8984b" released by "delete_volume" :: held 0.774s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Created reservations ['0665153a-3b00-4295-8bb4-5e5d31333734', 'd1583320-508d-4ea8-98ea-e953433083fa', '1a381fc9-cdaa-4903-95d5-3d2a38380d5e', '7d3dd89c-9c94-44be-853e-66de55d64eaf'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:38 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:54:38 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:38 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.283s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:54:38 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Deleted volume successfully.
Nov 05 18:54:38 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-eb8bbf62-9f43-4b0f-b0e9-fdc2917c4afb tempest-ProjectReaderTests-1695604257 None] Lock "cinder-9c32e948-bb75-42f0-9e0c-06d61fb8984b-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Flow 'volume_create_manager' (fcbc05ab-9bc7-49eb-9ac3-aa2a819c49bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48fffb1-6026-4181-994c-848d7c2c0e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48fffb1-6026-4181-994c-848d7c2c0e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1342229410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244c8bbf-68f3-4439-90ea-40fb8c6957a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745128d0c8584ac096ee302df93bd2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:39Z,use_quota=True,user_id='d8cc59d844b943d39ec13ff38d5ec4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fdf142-7b18-46f4-a821-c1861336f416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fdf142-7b18-46f4-a821-c1861336f416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f23c53-e54b-4cf0-9a17-ef90a925a9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f23c53-e54b-4cf0-9a17-ef90a925a9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244c8bbf-68f3-4439-90ea-40fb8c6957a4', 'volume_name': 'volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf894845-c5ae-4b47-8b17-ad2c93c62f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf894845-c5ae-4b47-8b17-ad2c93c62f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe8d23e-d636-4793-a8c4-d62b17b1dfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:39 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Volume 244c8bbf-68f3-4439-90ea-40fb8c6957a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4', 'volume_size': 1}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1342229410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244c8bbf-68f3-4439-90ea-40fb8c6957a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745128d0c8584ac096ee302df93bd2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:39Z,use_quota=True,user_id='d8cc59d844b943d39ec13ff38d5ec4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Creating volume 244c8bbf-68f3-4439-90ea-40fb8c6957a4 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:54:39 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:39 devstack sudo[107707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 1073741824
Nov 05 18:54:39 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:39 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 1073741824" returned: 0 in 0.407s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:39 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:39 devstack sudo[107713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4
Nov 05 18:54:39 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:40 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4" returned: 0 in 0.253s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe8d23e-d636-4793-a8c4-d62b17b1dfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b8a64d-70b2-4822-88b8-65f2b9afd872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:40 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Volume volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 (244c8bbf-68f3-4439-90ea-40fb8c6957a4): created successfully
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b8a64d-70b2-4822-88b8-65f2b9afd872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Flow 'volume_create_manager' (fcbc05ab-9bc7-49eb-9ac3-aa2a819c49bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:40 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-fa07a23d-6a00-46e0-9e06-83a544745880 tempest-ProjectReaderTests-1695604257 None] Created volume successfully.
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Creating offline snapshot 7dad5383-c468-48e5-bdf9-a901cfe9a625 of volume 244c8bbf-68f3-4439-90ea-40fb8c6957a4 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e5fa8f-ce5f-4bde-9056-bd0ac62c392b]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:40 devstack sudo[107716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4
Nov 05 18:54:40 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:40 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4" returned: 0 in 0.361s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:40 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:40 devstack sudo[107721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625 1G
Nov 05 18:54:40 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:41 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625 1G" returned: 0 in 0.385s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:41 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625
Nov 05 18:54:41 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:41 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625" returned: 0 in 0.341s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:41 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625 is being set with open permissions: ugo+rw
Nov 05 18:54:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:41 devstack sudo[107732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625
Nov 05 18:54:41 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:41 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625" returned: 0 in 0.237s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:41 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:41 devstack sudo[107735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.info
Nov 05 18:54:41 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:42 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.info" returned: 0 in 0.276s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:42 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.info is being set with open permissions: ugo+rw
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:42 devstack sudo[107738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.info
Nov 05 18:54:42 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:42 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.info" returned: 0 in 0.261s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:42 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b8c19b56-dca1-4973-83d4-d92002f15339 tempest-ProjectReaderTests-1695604257 None] Create snapshot completed successfully
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-7dad5383-c468-48e5-bdf9-a901cfe9a625-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-7dad5383-c468-48e5-bdf9-a901cfe9a625-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-244c8bbf-68f3-4439-90ea-40fb8c6957a4" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-244c8bbf-68f3-4439-90ea-40fb8c6957a4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-7dad5383-c468-48e5-bdf9-a901cfe9a625" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-7dad5383-c468-48e5-bdf9-a901cfe9a625" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Deleting offline snapshot 7dad5383-c468-48e5-bdf9-a901cfe9a625 of volume 244c8bbf-68f3-4439-90ea-40fb8c6957a4 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] snapshot_file for this snap is: volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa502de-c083-451f-bbb6-7164c1dc7ae5]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:42 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:42 devstack sudo[107741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625
Nov 05 18:54:42 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:43 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625" returned: 0 in 0.356s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:43 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:54:43 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d39125-f069-433d-9a32-d1b699fc7082]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:43 devstack sudo[107746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4
Nov 05 18:54:43 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:43 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4" returned: 0 in 0.344s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:43 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625
Nov 05 18:54:43 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:43 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625" returned: 0 in 0.321s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:43 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:43 devstack sudo[107756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625
Nov 05 18:54:43 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:44 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4.7dad5383-c468-48e5-bdf9-a901cfe9a625" returned: 0 in 0.232s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-7dad5383-c468-48e5-bdf9-a901cfe9a625" released by "_delete_snapshot" :: held 1.346s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-244c8bbf-68f3-4439-90ea-40fb8c6957a4" released by "delete_snapshot" :: held 1.369s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Created reservations ['b3622403-946c-4bbe-a8a4-294ea227c56a', '0151d0cb-67da-4453-8a37-c3c2d747904b', '87611f5c-f1fc-4070-bb37-2ae8d278b898', '00fba748-138c-448b-ac3c-2f055499b3c9'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:44 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Delete snapshot completed successfully.
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-40fb95f1-3fa3-477e-8028-b96d57542419 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-7dad5383-c468-48e5-bdf9-a901cfe9a625-delete_snapshot" released by "delete_snapshot" :: held 1.499s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-244c8bbf-68f3-4439-90ea-40fb8c6957a4-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Lock "cinder-244c8bbf-68f3-4439-90ea-40fb8c6957a4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-244c8bbf-68f3-4439-90ea-40fb8c6957a4" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-244c8bbf-68f3-4439-90ea-40fb8c6957a4" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[a554f7aa-c1d8-46fc-8818-f1acf5d3d62d]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:44 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:45 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4
Nov 05 18:54:45 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:45 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4" returned: 0 in 0.336s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:45 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4
Nov 05 18:54:45 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:45 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-244c8bbf-68f3-4439-90ea-40fb8c6957a4" returned: 0 in 0.248s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-244c8bbf-68f3-4439-90ea-40fb8c6957a4" released by "delete_volume" :: held 0.652s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Created reservations ['ba48cf26-a96b-42c2-83e4-16a0065eccdf', '0ce79713-5210-42e0-814f-9631f031188f', '1d398265-470d-4e04-b3a5-a5876aec322d', 'a4daa5d3-4876-40ed-bc5b-95888a95ebc5'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:45 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:54:45 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:45 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.283s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:54:45 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Deleted volume successfully.
Nov 05 18:54:45 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f897373f-ebe7-4f57-97af-d88841a0952e tempest-ProjectReaderTests-1695604257 None] Lock "cinder-244c8bbf-68f3-4439-90ea-40fb8c6957a4-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Flow 'volume_create_manager' (cd78b956-5175-4c25-a8f5-96ca0a0a8b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c0e389-d829-417b-ba66-d93a58a4f517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c0e389-d829-417b-ba66-d93a58a4f517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1669877547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24c14af-0077-44d7-a967-e0d15b7f2b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745128d0c8584ac096ee302df93bd2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:46Z,use_quota=True,user_id='d8cc59d844b943d39ec13ff38d5ec4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b42093-8784-43e5-bd54-a08063c58da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b42093-8784-43e5-bd54-a08063c58da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8d367e-6d68-499b-a762-044a260b209a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8d367e-6d68-499b-a762-044a260b209a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f24c14af-0077-44d7-a967-e0d15b7f2b93', 'volume_name': 'volume-f24c14af-0077-44d7-a967-e0d15b7f2b93', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7630c12-1996-4d65-8a8f-26ae1ffa1525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7630c12-1996-4d65-8a8f-26ae1ffa1525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0e5ea1-6f3a-4f14-9cfd-5654196b642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:46 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Volume f24c14af-0077-44d7-a967-e0d15b7f2b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f24c14af-0077-44d7-a967-e0d15b7f2b93', 'volume_size': 1}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1669877547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24c14af-0077-44d7-a967-e0d15b7f2b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745128d0c8584ac096ee302df93bd2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:46Z,use_quota=True,user_id='d8cc59d844b943d39ec13ff38d5ec4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Creating volume f24c14af-0077-44d7-a967-e0d15b7f2b93 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:54:46 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:46 devstack sudo[107777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 1073741824
Nov 05 18:54:46 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:46 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 1073741824" returned: 0 in 0.428s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:46 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:46 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93
Nov 05 18:54:46 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:47 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93" returned: 0 in 0.242s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0e5ea1-6f3a-4f14-9cfd-5654196b642b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24c14af-0077-44d7-a967-e0d15b7f2b93', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd2eafd-ec02-4850-bd67-55906fb1a969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:47 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Volume volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 (f24c14af-0077-44d7-a967-e0d15b7f2b93): created successfully
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd2eafd-ec02-4850-bd67-55906fb1a969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Flow 'volume_create_manager' (cd78b956-5175-4c25-a8f5-96ca0a0a8b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:47 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-b4ec7f08-d705-4f7d-a0fb-11fbe245272b tempest-ProjectReaderTests-1695604257 None] Created volume successfully.
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Creating offline snapshot 8bab9394-e17b-4bf0-a20f-542085c08530 of volume f24c14af-0077-44d7-a967-e0d15b7f2b93 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b942b-96aa-4adc-b60a-8878864098fd]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:47 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:47 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93
Nov 05 18:54:47 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:48 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93" returned: 0 in 0.399s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:48 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530 1G
Nov 05 18:54:48 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:48 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530 1G" returned: 0 in 0.432s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:48 devstack sudo[107795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530
Nov 05 18:54:48 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:48 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530" returned: 0 in 0.312s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:48 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530 is being set with open permissions: ugo+rw
Nov 05 18:54:48 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:48 devstack sudo[107800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530
Nov 05 18:54:48 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:49 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530" returned: 0 in 0.244s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:49 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.info
Nov 05 18:54:49 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:49 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.info" returned: 0 in 0.280s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:49 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.info is being set with open permissions: ugo+rw
Nov 05 18:54:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:49 devstack sudo[107806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.info
Nov 05 18:54:49 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:49 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.info" returned: 0 in 0.247s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:49 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:49 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2277ad86-d94c-4eee-a526-ad2eb9df6545 tempest-ProjectReaderTests-1695604257 None] Create snapshot completed successfully
Nov 05 18:54:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-8bab9394-e17b-4bf0-a20f-542085c08530-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-8bab9394-e17b-4bf0-a20f-542085c08530-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-f24c14af-0077-44d7-a967-e0d15b7f2b93" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-f24c14af-0077-44d7-a967-e0d15b7f2b93" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-8bab9394-e17b-4bf0-a20f-542085c08530" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:50 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-8bab9394-e17b-4bf0-a20f-542085c08530" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Deleting offline snapshot 8bab9394-e17b-4bf0-a20f-542085c08530 of volume f24c14af-0077-44d7-a967-e0d15b7f2b93 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:54:50 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] snapshot_file for this snap is: volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:54:50 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[b364aa71-582e-4f35-8071-4c12ea745c80]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:50 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:50 devstack sudo[107809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530
Nov 05 18:54:50 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:51 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530" returned: 0 in 0.357s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:51 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f24c14af-0077-44d7-a967-e0d15b7f2b93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:54:51 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ef5709-31b9-44ac-97c4-0725b00d9aec]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:51 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93
Nov 05 18:54:51 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:51 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93" returned: 0 in 0.353s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:51 devstack sudo[107819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530
Nov 05 18:54:51 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:51 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530" returned: 0 in 0.328s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:51 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:51 devstack sudo[107824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530
Nov 05 18:54:51 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:52 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:52 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93.8bab9394-e17b-4bf0-a20f-542085c08530" returned: 0 in 0.239s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-8bab9394-e17b-4bf0-a20f-542085c08530" released by "_delete_snapshot" :: held 1.368s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-f24c14af-0077-44d7-a967-e0d15b7f2b93" released by "delete_snapshot" :: held 1.393s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:52 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Created reservations ['3a453108-17a9-4584-b723-6bee96c1798d', '5d0fa1a0-8d5a-4406-86d0-36d170bdf60d', 'edfa7894-9a77-4d19-9170-cef91ebe9d6a', 'c7d71b39-ef6e-4d57-afe4-63d72594ed16'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:52 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Delete snapshot completed successfully.
Nov 05 18:54:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1d1f26b9-856c-4eee-9b40-0652fc5b9008 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-8bab9394-e17b-4bf0-a20f-542085c08530-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-f24c14af-0077-44d7-a967-e0d15b7f2b93-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Lock "cinder-f24c14af-0077-44d7-a967-e0d15b7f2b93-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-f24c14af-0077-44d7-a967-e0d15b7f2b93" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:52 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-f24c14af-0077-44d7-a967-e0d15b7f2b93" acquired by "delete_volume" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9d89fe-90a0-48c3-9f45-4943cf97ffb8]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:53 devstack sudo[107827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93
Nov 05 18:54:53 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:53 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93" returned: 0 in 0.361s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:53 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93
Nov 05 18:54:53 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:53 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f24c14af-0077-44d7-a967-e0d15b7f2b93" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-f24c14af-0077-44d7-a967-e0d15b7f2b93" released by "delete_volume" :: held 0.686s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Created reservations ['bb45cffe-ad12-4a63-898f-ede2ed1ca2a8', '13a84f25-f6bc-4509-b7b1-278a448837ed', '931920ff-0c99-45a8-bf6b-984e6f5d735f', 'a8c0d4ba-d145-49a0-bfe2-73afa2ebeb91'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:53 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:53 devstack sudo[107836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:54:53 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:54 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.258s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:54:54 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Deleted volume successfully.
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-cfae6063-d9f2-4dcc-9324-84a2ec9a375a tempest-ProjectReaderTests-1695604257 None] Lock "cinder-f24c14af-0077-44d7-a967-e0d15b7f2b93-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Flow 'volume_create_manager' (612d73aa-fdd2-433e-b50f-2ce3de44a6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693d0984-273e-49c3-94f7-44f6bc5770ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693d0984-273e-49c3-94f7-44f6bc5770ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619321270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcea761-bb6f-4c53-8c91-1e9bb388de39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745128d0c8584ac096ee302df93bd2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:54Z,use_quota=True,user_id='d8cc59d844b943d39ec13ff38d5ec4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00d7172-ed94-4acc-9e4b-245e5b35101f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00d7172-ed94-4acc-9e4b-245e5b35101f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e2fd01-54ee-444d-9cd4-5599686fd5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e2fd01-54ee-444d-9cd4-5599686fd5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adcea761-bb6f-4c53-8c91-1e9bb388de39', 'volume_name': 'volume-adcea761-bb6f-4c53-8c91-1e9bb388de39', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4750fbc-cd92-4f44-ae71-7024232e9e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4750fbc-cd92-4f44-ae71-7024232e9e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2461ec50-359f-47b1-890a-1a9acf80daa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:54 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Volume adcea761-bb6f-4c53-8c91-1e9bb388de39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adcea761-bb6f-4c53-8c91-1e9bb388de39', 'volume_size': 1}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619321270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcea761-bb6f-4c53-8c91-1e9bb388de39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745128d0c8584ac096ee302df93bd2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:54:54Z,use_quota=True,user_id='d8cc59d844b943d39ec13ff38d5ec4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Creating volume adcea761-bb6f-4c53-8c91-1e9bb388de39 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:54:54 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:54:54 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:54 devstack sudo[107839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 1073741824
Nov 05 18:54:54 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:55 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 1073741824" returned: 0 in 0.450s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:55 devstack sudo[107879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39
Nov 05 18:54:55 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:55 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39" returned: 0 in 0.253s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2461ec50-359f-47b1-890a-1a9acf80daa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adcea761-bb6f-4c53-8c91-1e9bb388de39', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ea4c07-ca3b-43bb-8acc-30bca1cc018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:54:55 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Volume volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 (adcea761-bb6f-4c53-8c91-1e9bb388de39): created successfully
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ea4c07-ca3b-43bb-8acc-30bca1cc018b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Flow 'volume_create_manager' (612d73aa-fdd2-433e-b50f-2ce3de44a6cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:54:55 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d5a5cb75-bbcc-4349-8155-68d3cf51080c tempest-ProjectReaderTests-1695604257 None] Created volume successfully.
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Creating offline snapshot 2631a719-5dc4-4a45-92eb-335a54b069f3 of volume adcea761-bb6f-4c53-8c91-1e9bb388de39 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[518e82b3-76b0-4577-b1e0-ef3b39beb074]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:55 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:55 devstack sudo[107884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39
Nov 05 18:54:55 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:56 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39" returned: 0 in 0.345s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:56 devstack sudo[107890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3 1G
Nov 05 18:54:56 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:56 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3 1G" returned: 0 in 0.396s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:56 devstack sudo[107895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3
Nov 05 18:54:56 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:56 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3" returned: 0 in 0.270s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:56 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3 is being set with open permissions: ugo+rw
Nov 05 18:54:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:56 devstack sudo[107901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3
Nov 05 18:54:56 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:56 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:56 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3" returned: 0 in 0.243s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:57 devstack sudo[107904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.info
Nov 05 18:54:57 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:57 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.info" returned: 0 in 0.259s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:57 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.info is being set with open permissions: ugo+rw
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:57 devstack sudo[107907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.info
Nov 05 18:54:57 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:57 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.info" returned: 0 in 0.248s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:54:57 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d5f6132a-b986-4868-adeb-623e3affd1ed tempest-ProjectReaderTests-1695604257 None] Create snapshot completed successfully
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-2631a719-5dc4-4a45-92eb-335a54b069f3-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Lock "cinder-2631a719-5dc4-4a45-92eb-335a54b069f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-adcea761-bb6f-4c53-8c91-1e9bb388de39" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-adcea761-bb6f-4c53-8c91-1e9bb388de39" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-2631a719-5dc4-4a45-92eb-335a54b069f3" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-2631a719-5dc4-4a45-92eb-335a54b069f3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Deleting offline snapshot 2631a719-5dc4-4a45-92eb-335a54b069f3 of volume adcea761-bb6f-4c53-8c91-1e9bb388de39 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] snapshot_file for this snap is: volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[3588a4c4-a4ef-4048-bddc-c2f96036c0e0]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:57 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:58 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3
Nov 05 18:54:58 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:58 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3" returned: 0 in 0.357s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:58 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adcea761-bb6f-4c53-8c91-1e9bb388de39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:54:58 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c49ba8-8263-4174-ba09-9e5cf29ff12a]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:54:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:58 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39
Nov 05 18:54:58 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:58 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39" returned: 0 in 0.355s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:58 devstack sudo[107920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3
Nov 05 18:54:58 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:58 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3" returned: 0 in 0.319s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:58 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:54:58 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3
Nov 05 18:54:58 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:54:59 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Nov 05 18:54:59 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39.2631a719-5dc4-4a45-92eb-335a54b069f3" returned: 0 in 0.229s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:54:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-2631a719-5dc4-4a45-92eb-335a54b069f3" released by "_delete_snapshot" :: held 1.357s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-adcea761-bb6f-4c53-8c91-1e9bb388de39" released by "delete_snapshot" :: held 1.380s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:59 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Created reservations ['a509cbd0-e788-4d86-8fce-a15b866fbcad', '74ba52aa-db02-458c-ae72-739c43b9ed4d', 'f68cef28-dd6b-4190-8085-84a538efe5b4', '04f65970-4468-4cef-b62b-a599f76b47e1'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:54:59 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Delete snapshot completed successfully.
Nov 05 18:54:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2f672bf6-114f-4939-99f8-8cd8565f5b9e tempest-ProjectReaderTests-1695604257 None] Lock "cinder-2631a719-5dc4-4a45-92eb-335a54b069f3-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:54:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-adcea761-bb6f-4c53-8c91-1e9bb388de39-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:54:59 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-adcea761-bb6f-4c53-8c91-1e9bb388de39-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-adcea761-bb6f-4c53-8c91-1e9bb388de39" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-adcea761-bb6f-4c53-8c91-1e9bb388de39" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3048e1f-2bea-4928-bb6b-04e00c7c00c4]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:00 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39
Nov 05 18:55:00 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:00 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39" returned: 0 in 0.377s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:00 devstack sudo[108113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39
Nov 05 18:55:00 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:00 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-adcea761-bb6f-4c53-8c91-1e9bb388de39" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-adcea761-bb6f-4c53-8c91-1e9bb388de39" released by "delete_volume" :: held 0.694s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Created reservations ['1d1efad4-0945-4c08-9eb2-4e4803c193c8', '91f81169-a2ac-4a47-9cbe-967656906969', 'd8d1da52-4e9e-4710-a852-b516a2af7c83', 'dea766aa-d861-4286-bc27-5b203248f678'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:00 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:00 devstack sudo[108265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:55:00 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:01 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.265s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:55:01 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Deleted volume successfully.
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-4dd968ce-4d3b-4e41-b33b-3880959c55c7 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-adcea761-bb6f-4c53-8c91-1e9bb388de39-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Flow 'volume_create_manager' (e8b9e729-a760-4ff0-9da7-c3b7fce0e1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08813373-fdb6-40e3-a114-9ccc126e4e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08813373-fdb6-40e3-a114-9ccc126e4e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912352297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2134c396-69a4-4a1b-8c64-e4601df9ce61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745128d0c8584ac096ee302df93bd2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:02Z,use_quota=True,user_id='d8cc59d844b943d39ec13ff38d5ec4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187ea2f1-7d75-4f2e-9feb-fd9c7f7cba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187ea2f1-7d75-4f2e-9feb-fd9c7f7cba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1685d88e-65b9-4fa1-8012-9fc74aefd9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1685d88e-65b9-4fa1-8012-9fc74aefd9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2134c396-69a4-4a1b-8c64-e4601df9ce61', 'volume_name': 'volume-2134c396-69a4-4a1b-8c64-e4601df9ce61', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a477644a-cd64-4cb9-8537-8170b83e8b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a477644a-cd64-4cb9-8537-8170b83e8b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be21e8ac-4b7e-495e-b79a-de0a48ef5a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:01 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Volume 2134c396-69a4-4a1b-8c64-e4601df9ce61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2134c396-69a4-4a1b-8c64-e4601df9ce61', 'volume_size': 1}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912352297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2134c396-69a4-4a1b-8c64-e4601df9ce61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745128d0c8584ac096ee302df93bd2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:02Z,use_quota=True,user_id='d8cc59d844b943d39ec13ff38d5ec4d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Creating volume 2134c396-69a4-4a1b-8c64-e4601df9ce61 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:55:01 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:55:01 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:01 devstack sudo[108271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 1073741824
Nov 05 18:55:01 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:02 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 1073741824" returned: 0 in 0.410s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:02 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61
Nov 05 18:55:02 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:02 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61" returned: 0 in 0.268s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be21e8ac-4b7e-495e-b79a-de0a48ef5a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2134c396-69a4-4a1b-8c64-e4601df9ce61', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d40aed5-015d-4d80-a1af-d70ffe04355b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:02 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Volume volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 (2134c396-69a4-4a1b-8c64-e4601df9ce61): created successfully
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d40aed5-015d-4d80-a1af-d70ffe04355b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Flow 'volume_create_manager' (e8b9e729-a760-4ff0-9da7-c3b7fce0e1aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:02 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-d96aff3a-6e1b-41f4-ae39-4ae7fea92b57 tempest-ProjectReaderTests-1695604257 None] Created volume successfully.
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Creating offline snapshot baa48f79-4784-441f-bdbf-f57d563575c7 of volume 2134c396-69a4-4a1b-8c64-e4601df9ce61 {{(pid=87086) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf3b285-38d2-41bf-9bbf-ba4c8a32d401]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:02 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:02 devstack sudo[108280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61
Nov 05 18:55:02 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:03 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61" returned: 0 in 0.360s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7 1G {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:03 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7 1G
Nov 05 18:55:03 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:03 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7 1G" returned: 0 in 0.401s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:03 devstack sudo[108290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7
Nov 05 18:55:03 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:03 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 -F qcow2 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7" returned: 0 in 0.319s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:03 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7 is being set with open permissions: ugo+rw
Nov 05 18:55:03 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:03 devstack sudo[108295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7
Nov 05 18:55:03 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:04 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7" returned: 0 in 0.232s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:04 devstack sudo[108298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.info
Nov 05 18:55:04 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:04 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.info" returned: 0 in 0.249s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:04 devstack cinder-volume[87086]: WARNING cinder.volume.drivers.remotefs [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.info is being set with open permissions: ugo+rw
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.info {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:04 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.info
Nov 05 18:55:04 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:04 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.info" returned: 0 in 0.227s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:04 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-eabc266c-4dde-4e53-b068-4b6d04dbd44d tempest-ProjectReaderTests-1695604257 None] Create snapshot completed successfully
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-baa48f79-4784-441f-bdbf-f57d563575c7-delete_snapshot" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-baa48f79-4784-441f-bdbf-f57d563575c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-2134c396-69a4-4a1b-8c64-e4601df9ce61" by "delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-2134c396-69a4-4a1b-8c64-e4601df9ce61" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-baa48f79-4784-441f-bdbf-f57d563575c7" by "_delete_snapshot" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-baa48f79-4784-441f-bdbf-f57d563575c7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Deleting offline snapshot baa48f79-4784-441f-bdbf-f57d563575c7 of volume 2134c396-69a4-4a1b-8c64-e4601df9ce61 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 18:55:04 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] snapshot_file for this snap is: volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7 {{(pid=87086) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 18:55:05 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db2f611-c1ee-41c8-9aae-9f16a38a5c24]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:05 devstack sudo[108304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7
Nov 05 18:55:05 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:05 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7" returned: 0 in 0.377s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:05 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2134c396-69a4-4a1b-8c64-e4601df9ce61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87086) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 18:55:05 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7304f6b-f8eb-4993-9828-2c879db665de]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:05 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61
Nov 05 18:55:05 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:05 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61" returned: 0 in 0.372s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:05 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:05 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7
Nov 05 18:55:05 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:06 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7" returned: 0 in 0.332s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:06 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7
Nov 05 18:55:06 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:06 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:06 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61.baa48f79-4784-441f-bdbf-f57d563575c7" returned: 0 in 0.270s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-baa48f79-4784-441f-bdbf-f57d563575c7" released by "_delete_snapshot" :: held 1.450s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-2134c396-69a4-4a1b-8c64-e4601df9ce61" released by "delete_snapshot" :: held 1.473s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:06 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Created reservations ['387bbf46-0a62-49a9-baad-bac552a5cbfd', 'cea3d1e0-543a-4794-9e18-cc85250e7d91', '0ae4caa6-39bf-4c00-a00f-ae46631dc3b6', '3af80c65-830f-4be0-8de5-8bce8ccd620c'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:55:06 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Delete snapshot completed successfully.
Nov 05 18:55:06 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-1e8f079e-616e-400c-8bbb-62ef4d42a118 tempest-ProjectReaderTests-1695604257 None] Lock "cinder-baa48f79-4784-441f-bdbf-f57d563575c7-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-2134c396-69a4-4a1b-8c64-e4601df9ce61-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Lock "cinder-2134c396-69a4-4a1b-8c64-e4601df9ce61-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Acquiring lock "cinder-quobyte-2134c396-69a4-4a1b-8c64-e4601df9ce61" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-2134c396-69a4-4a1b-8c64-e4601df9ce61" acquired by "delete_volume" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[2634694b-eb3c-48ab-9cb2-42566be29c81]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:07 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61
Nov 05 18:55:07 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:07 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61" returned: 0 in 0.368s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:07 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61
Nov 05 18:55:07 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:07 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-2134c396-69a4-4a1b-8c64-e4601df9ce61" returned: 0 in 0.244s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Lock "cinder-quobyte-2134c396-69a4-4a1b-8c64-e4601df9ce61" released by "delete_volume" :: held 0.684s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:07 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Created reservations ['ade35d54-c236-425f-a73a-198915c019d2', '7f7cb7e4-b3ef-4d99-8e3c-f3726422254c', '81cd1084-be3f-40b0-8c52-aae0dd87e566', '60458d11-0bbd-4017-ae3c-dad7b96bfaf6'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:55:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:08 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:08 devstack sudo[108332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:55:08 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:08 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:08 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.285s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:08 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:55:08 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Deleted volume successfully.
Nov 05 18:55:08 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-f84089db-8903-42f0-8b2d-60623897c7db tempest-ProjectReaderTests-1695604257 None] Lock "cinder-2134c396-69a4-4a1b-8c64-e4601df9ce61-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=108,cinder:INSERT=40,cinder:UPDATE=123,cinder:DELETE=11 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:UPDATE=145,cinder:SELECT=95,cinder:INSERT=34,cinder:DELETE=11 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Flow 'volume_create_manager' (117d6a34-7787-45cd-b502-3c26d6e9c2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dab72a2-6502-4a5c-ba57-1f41c8fc9522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dab72a2-6502-4a5c-ba57-1f41c8fc9522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739140165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba431213-d252-43ee-a9c9-1af65b6fbbb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90565f5bc7943868cd2f9e1d492a6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:12Z,use_quota=True,user_id='8032d68f3015413ba965395d181be19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83581ce2-d708-42be-8a6e-aac7b59166dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83581ce2-d708-42be-8a6e-aac7b59166dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5bc8e9-8086-46f5-a54f-7e459dfbc02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5bc8e9-8086-46f5-a54f-7e459dfbc02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba431213-d252-43ee-a9c9-1af65b6fbbb6', 'volume_name': 'volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7146ddd7-be74-4268-811e-c968870f0a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7146ddd7-be74-4268-811e-c968870f0a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c6760c-20ef-41b7-b518-3497496a8671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:12 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Volume ba431213-d252-43ee-a9c9-1af65b6fbbb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6', 'volume_size': 1}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-739140165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba431213-d252-43ee-a9c9-1af65b6fbbb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90565f5bc7943868cd2f9e1d492a6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:12Z,use_quota=True,user_id='8032d68f3015413ba965395d181be19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Creating volume ba431213-d252-43ee-a9c9-1af65b6fbbb6 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:55:12 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:12 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6 1073741824
Nov 05 18:55:12 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:12 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6 1073741824" returned: 0 in 0.437s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:12 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:12 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6
Nov 05 18:55:12 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:13 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6" returned: 0 in 0.251s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c6760c-20ef-41b7-b518-3497496a8671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6361625-c07d-40e2-9f9d-cebdf9c61060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:13 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Volume volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6 (ba431213-d252-43ee-a9c9-1af65b6fbbb6): created successfully
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6361625-c07d-40e2-9f9d-cebdf9c61060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Flow 'volume_create_manager' (117d6a34-7787-45cd-b502-3c26d6e9c2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:13 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2b5b5781-270f-423c-8225-13542bc127e0 tempest-ProjectReaderTests-119866988 None] Created volume successfully.
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Acquiring lock "cinder-ba431213-d252-43ee-a9c9-1af65b6fbbb6-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Lock "cinder-ba431213-d252-43ee-a9c9-1af65b6fbbb6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Acquiring lock "cinder-quobyte-ba431213-d252-43ee-a9c9-1af65b6fbbb6" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Lock "cinder-quobyte-ba431213-d252-43ee-a9c9-1af65b6fbbb6" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[e041397f-d4e6-4611-ae00-947d1bbb3951]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:13 devstack sudo[108345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6
Nov 05 18:55:13 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:13 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6" returned: 0 in 0.341s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:13 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:13 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6
Nov 05 18:55:13 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:14 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-ba431213-d252-43ee-a9c9-1af65b6fbbb6" returned: 0 in 0.235s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Lock "cinder-quobyte-ba431213-d252-43ee-a9c9-1af65b6fbbb6" released by "delete_volume" :: held 0.615s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Created reservations ['96716080-0fa7-4107-8e23-894e2f577cd5', '5abc7684-6847-4b62-8d4c-ca2d00c4ae36', '170bf7da-bffc-4e90-bd1c-a7aa3fa2bad1', '62c972fa-5018-4304-bf79-85e8a23d5165'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:14 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:55:14 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:14 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.239s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:55:14 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Deleted volume successfully.
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-79b213cf-ceb1-4ef3-9033-7796370377b2 tempest-ProjectReaderTests-119866988 None] Lock "cinder-ba431213-d252-43ee-a9c9-1af65b6fbbb6-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Flow 'volume_create_manager' (788a6a82-4d98-4c61-854e-b30925beb857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112114de-3b03-4108-8171-6d004a0abc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112114de-3b03-4108-8171-6d004a0abc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271264189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15c01d9-0c19-4e42-a4a2-b1287bdf5207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90565f5bc7943868cd2f9e1d492a6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:15Z,use_quota=True,user_id='8032d68f3015413ba965395d181be19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:14 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf33922-52c9-439b-8b65-7bfac16094d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf33922-52c9-439b-8b65-7bfac16094d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904e0561-f4cc-4d1c-a66a-6902fdbc2232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904e0561-f4cc-4d1c-a66a-6902fdbc2232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15c01d9-0c19-4e42-a4a2-b1287bdf5207', 'volume_name': 'volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b727bed2-7123-4683-a205-ef0a5d2c4d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b727bed2-7123-4683-a205-ef0a5d2c4d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6eee96-6c32-460a-90b4-b7ea8a230272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:15 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Volume f15c01d9-0c19-4e42-a4a2-b1287bdf5207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207', 'volume_size': 1}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271264189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15c01d9-0c19-4e42-a4a2-b1287bdf5207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90565f5bc7943868cd2f9e1d492a6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:15Z,use_quota=True,user_id='8032d68f3015413ba965395d181be19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Creating volume f15c01d9-0c19-4e42-a4a2-b1287bdf5207 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:55:15 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:15 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207 1073741824
Nov 05 18:55:15 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:15 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207 1073741824" returned: 0 in 0.397s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:15 devstack sudo[108363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207
Nov 05 18:55:15 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:15 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207" returned: 0 in 0.234s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6eee96-6c32-460a-90b4-b7ea8a230272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2cfbf7-9f5c-4439-9871-5dbfa25e2060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:15 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Volume volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207 (f15c01d9-0c19-4e42-a4a2-b1287bdf5207): created successfully
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2cfbf7-9f5c-4439-9871-5dbfa25e2060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:15 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Flow 'volume_create_manager' (788a6a82-4d98-4c61-854e-b30925beb857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:15 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-ad026493-daf3-4a5a-ada4-45ecfeb500fa tempest-ProjectReaderTests-119866988 None] Created volume successfully.
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Acquiring lock "cinder-f15c01d9-0c19-4e42-a4a2-b1287bdf5207-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Lock "cinder-f15c01d9-0c19-4e42-a4a2-b1287bdf5207-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Acquiring lock "cinder-quobyte-f15c01d9-0c19-4e42-a4a2-b1287bdf5207" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Lock "cinder-quobyte-f15c01d9-0c19-4e42-a4a2-b1287bdf5207" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5537226-12e1-488b-b4a4-9c00ab8f3ad7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:16 devstack sudo[108367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207
Nov 05 18:55:16 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:16 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207" returned: 0 in 0.376s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:16 devstack sudo[108372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207
Nov 05 18:55:16 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:16 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-f15c01d9-0c19-4e42-a4a2-b1287bdf5207" returned: 0 in 0.225s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Lock "cinder-quobyte-f15c01d9-0c19-4e42-a4a2-b1287bdf5207" released by "delete_volume" :: held 0.640s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Created reservations ['0a61a3f3-f57b-43ac-99a2-889adcfb6e8b', 'e1a7fd95-2d95-4184-930f-d7725b1b301f', 'd33fc86f-c0b7-4586-a1b3-3fae34fad010', '5ee96794-3318-4ded-92e2-480e62ff2316'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:16 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:16 devstack sudo[108375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:55:16 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:17 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:17 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.231s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:17 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:55:17 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Deleted volume successfully.
Nov 05 18:55:17 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-bb8aa64d-570c-45a8-a264-18d6850484bf tempest-ProjectReaderTests-119866988 None] Lock "cinder-f15c01d9-0c19-4e42-a4a2-b1287bdf5207-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Flow 'volume_create_manager' (a07b468f-7b53-49e7-a592-b4ab5941c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3585c317-2b3c-4eb1-b256-1ca518be318d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3585c317-2b3c-4eb1-b256-1ca518be318d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-550193320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91122a14-c1e7-4400-8c73-74361ecf684e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af4383f562c4220bb84cb153c78d9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:21Z,use_quota=True,user_id='a2328eb64ccf4bb7a78a3d4cbff55ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a81044-4037-4c6c-844b-ba715c4ab365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a81044-4037-4c6c-844b-ba715c4ab365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acee4f40-b9af-4fe4-8475-610b80b4a270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acee4f40-b9af-4fe4-8475-610b80b4a270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91122a14-c1e7-4400-8c73-74361ecf684e', 'volume_name': 'volume-91122a14-c1e7-4400-8c73-74361ecf684e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72376e9-b451-4802-afc5-648649f03b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72376e9-b451-4802-afc5-648649f03b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7680cbb7-d639-490c-82c1-b751411cf356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:20 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Volume 91122a14-c1e7-4400-8c73-74361ecf684e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91122a14-c1e7-4400-8c73-74361ecf684e', 'volume_size': 1}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-550193320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91122a14-c1e7-4400-8c73-74361ecf684e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af4383f562c4220bb84cb153c78d9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:21Z,use_quota=True,user_id='a2328eb64ccf4bb7a78a3d4cbff55ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Creating volume 91122a14-c1e7-4400-8c73-74361ecf684e {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:55:20 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:55:20 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:20 devstack sudo[108378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e 1073741824
Nov 05 18:55:20 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:21 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e 1073741824" returned: 0 in 0.420s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:21 devstack sudo[108383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e
Nov 05 18:55:21 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:21 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e" returned: 0 in 0.249s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7680cbb7-d639-490c-82c1-b751411cf356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91122a14-c1e7-4400-8c73-74361ecf684e', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a06d067-5afb-48f8-8ba8-dbf1cbe45d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:21 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Volume volume-91122a14-c1e7-4400-8c73-74361ecf684e (91122a14-c1e7-4400-8c73-74361ecf684e): created successfully
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a06d067-5afb-48f8-8ba8-dbf1cbe45d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Flow 'volume_create_manager' (a07b468f-7b53-49e7-a592-b4ab5941c653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:21 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-a8f8222b-1096-474b-97e2-976a0f1febc9 tempest-ProjectReaderTests-575787549 None] Created volume successfully.
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Acquiring lock "cinder-91122a14-c1e7-4400-8c73-74361ecf684e-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Lock "cinder-91122a14-c1e7-4400-8c73-74361ecf684e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Acquiring lock "cinder-quobyte-91122a14-c1e7-4400-8c73-74361ecf684e" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Lock "cinder-quobyte-91122a14-c1e7-4400-8c73-74361ecf684e" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3d6b78-ea9a-4a9f-95fd-ee78dc0581cd]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:21 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:22 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e
Nov 05 18:55:22 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:22 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e" returned: 0 in 0.354s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:22 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e
Nov 05 18:55:22 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:22 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-91122a14-c1e7-4400-8c73-74361ecf684e" returned: 0 in 0.263s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Lock "cinder-quobyte-91122a14-c1e7-4400-8c73-74361ecf684e" released by "delete_volume" :: held 0.658s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Created reservations ['529eefec-9734-4ada-8fcf-844eb3e11005', 'f49f83d9-caf8-44b8-bdca-bd9eb489c82d', 'ecbeb4f0-a559-4a11-ac40-093fddbb018f', '93eb338c-aaf6-43d4-a882-9f92a3a97b6b'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:22 devstack sudo[108394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:55:22 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:22 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.234s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:55:22 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Deleted volume successfully.
Nov 05 18:55:22 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-52c6b627-ad91-452f-8453-849712d3a471 tempest-ProjectReaderTests-575787549 None] Lock "cinder-91122a14-c1e7-4400-8c73-74361ecf684e-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Flow 'volume_create_manager' (01cf9e20-235b-4794-ad0b-c5ada2b0e01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404ea324-1924-4e9e-b4f4-ffcdf8c9b231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404ea324-1924-4e9e-b4f4-ffcdf8c9b231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707935508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7f0200-546a-4c2a-ba81-58a83b63f5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af4383f562c4220bb84cb153c78d9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:23Z,use_quota=True,user_id='a2328eb64ccf4bb7a78a3d4cbff55ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31eb1774-472b-4e52-9596-b542d785b666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31eb1774-472b-4e52-9596-b542d785b666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37400ea3-698a-4370-8ae4-ca03fc7596c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37400ea3-698a-4370-8ae4-ca03fc7596c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7f0200-546a-4c2a-ba81-58a83b63f5b9', 'volume_name': 'volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f5aaa7-7b57-4042-a349-6e592db28afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f5aaa7-7b57-4042-a349-6e592db28afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7827c33-c69a-4221-8840-2f0d95b103ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:23 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Volume 8b7f0200-546a-4c2a-ba81-58a83b63f5b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9', 'volume_size': 1}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-707935508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7f0200-546a-4c2a-ba81-58a83b63f5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af4383f562c4220bb84cb153c78d9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:23Z,use_quota=True,user_id='a2328eb64ccf4bb7a78a3d4cbff55ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Creating volume 8b7f0200-546a-4c2a-ba81-58a83b63f5b9 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:55:23 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:23 devstack sudo[108397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9 1073741824
Nov 05 18:55:23 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:23 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9 1073741824" returned: 0 in 0.423s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:23 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:23 devstack sudo[108403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9
Nov 05 18:55:23 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:24 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9" returned: 0 in 0.224s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7827c33-c69a-4221-8840-2f0d95b103ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd86b54-b257-4c09-9e86-9f9eec722216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:24 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Volume volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9 (8b7f0200-546a-4c2a-ba81-58a83b63f5b9): created successfully
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd86b54-b257-4c09-9e86-9f9eec722216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Flow 'volume_create_manager' (01cf9e20-235b-4794-ad0b-c5ada2b0e01a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:24 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-e4ca2d78-2354-470e-89d6-df2d8a14a864 tempest-ProjectReaderTests-575787549 None] Created volume successfully.
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Acquiring lock "cinder-8b7f0200-546a-4c2a-ba81-58a83b63f5b9-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Lock "cinder-8b7f0200-546a-4c2a-ba81-58a83b63f5b9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Acquiring lock "cinder-quobyte-8b7f0200-546a-4c2a-ba81-58a83b63f5b9" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Lock "cinder-quobyte-8b7f0200-546a-4c2a-ba81-58a83b63f5b9" acquired by "delete_volume" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[1822acb8-cbf4-43db-938e-588a4e8d57a7]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:24 devstack sudo[108406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9
Nov 05 18:55:24 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:24 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9" returned: 0 in 0.379s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:24 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:24 devstack sudo[108411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9
Nov 05 18:55:24 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:25 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-8b7f0200-546a-4c2a-ba81-58a83b63f5b9" returned: 0 in 0.273s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Lock "cinder-quobyte-8b7f0200-546a-4c2a-ba81-58a83b63f5b9" released by "delete_volume" :: held 0.691s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Created reservations ['6669b8df-1964-4f00-b762-33b503bea701', '3d64e570-a2dc-48b0-801d-fc089813f0bb', 'c9ee6e45-d1d4-448b-ba17-5ef7602de6bb', '0e329a05-e757-4605-9c3a-3acb9cf631cc'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:25 devstack sudo[108414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:55:25 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:25 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.267s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:55:25 devstack sudo[108417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:55:25 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Deleted volume successfully.
Nov 05 18:55:25 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-90bbf33a-20c0-4c6c-bd85-49504f5fdde0 tempest-ProjectReaderTests-575787549 None] Lock "cinder-8b7f0200-546a-4c2a-ba81-58a83b63f5b9-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:25 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.299s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG oslo_service.periodic_task [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] Running periodic task VolumeManager._thread_info {{(pid=87086) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread count: 28 {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}}
Nov 05 18:55:25 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-827fed6a-284d-4ae7-a51a-a8a670ba7912 None None] thread info: [<_MainThread(MainThread, started 126156003782784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126155893252416)>, <Thread(Thread-3 (stat_writer), started daemon 126155890118848)>, <Thread(Rabbit-heartbeat, started daemon 126155888830144)>, <Thread(Thread-5 (_runner), started daemon 126155887058240)>, <Thread(Thread-7 (_runner), started daemon 126155887205952)>, <Thread(fd_logger, started daemon 126155885119552)>, <Thread(privsep_reader, started daemon 126155885130432)>, <Thread(tpool_thread_0, started daemon 126155878631104)>, <Thread(tpool_thread_1, started daemon 126155870238400)>, <Thread(tpool_thread_2, started daemon 126155861845696)>, <Thread(tpool_thread_3, started daemon 126155853452992)>, <Thread(tpool_thread_4, started daemon 126155845060288)>, <Thread(tpool_thread_5, started daemon 126155836667584)>, <Thread(tpool_thread_6, started daemon 126155828274880)>, <Thread(tpool_thread_7, started daemon 126155819882176)>, <Thread(tpool_thread_8, started daemon 126155811489472)>, <Thread(tpool_thread_9, started daemon 126155803096768)>, <Thread(tpool_thread_10, started daemon 126155794704064)>, <Thread(tpool_thread_11, started daemon 126155786311360)>, <Thread(tpool_thread_12, started daemon 126155777918656)>, <Thread(tpool_thread_13, started daemon 126155769525952)>, <Thread(tpool_thread_14, started daemon 126155761133248)>, <Thread(tpool_thread_15, started daemon 126155752740544)>, <Thread(tpool_thread_16, started daemon 126155744347840)>, <Thread(tpool_thread_17, started daemon 126155735955136)>, <Thread(tpool_thread_18, started daemon 126155727562432)>, <Thread(tpool_thread_19, started daemon 126155719169728)>] {{(pid=87086) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Flow 'volume_create_manager' (a8ba6679-8f5c-4701-8ac3-2973452322c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee7e346-758f-46b8-ae23-14c23e8998ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee7e346-758f-46b8-ae23-14c23e8998ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-342844903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64ea55c-efa4-4213-beba-0554eeb455bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af4383f562c4220bb84cb153c78d9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:26Z,use_quota=True,user_id='a2328eb64ccf4bb7a78a3d4cbff55ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb196b5-29bd-49de-8456-c5de7deb890d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb196b5-29bd-49de-8456-c5de7deb890d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4529e7f4-2967-4dcc-b3f8-8227c3436d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4529e7f4-2967-4dcc-b3f8-8227c3436d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c64ea55c-efa4-4213-beba-0554eeb455bb', 'volume_name': 'volume-c64ea55c-efa4-4213-beba-0554eeb455bb', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be81ccc7-b0b1-4b1b-b609-736b53947ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be81ccc7-b0b1-4b1b-b609-736b53947ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a43d5b-a5db-4809-a5a9-a9262e277b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:26 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Volume c64ea55c-efa4-4213-beba-0554eeb455bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c64ea55c-efa4-4213-beba-0554eeb455bb', 'volume_size': 1}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-342844903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64ea55c-efa4-4213-beba-0554eeb455bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af4383f562c4220bb84cb153c78d9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:26Z,use_quota=True,user_id='a2328eb64ccf4bb7a78a3d4cbff55ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Creating volume c64ea55c-efa4-4213-beba-0554eeb455bb {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:55:26 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:26 devstack sudo[108421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb 1073741824
Nov 05 18:55:26 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:26 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb 1073741824" returned: 0 in 0.449s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:26 devstack sudo[108426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb
Nov 05 18:55:26 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:26 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb" returned: 0 in 0.260s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a43d5b-a5db-4809-a5a9-a9262e277b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c64ea55c-efa4-4213-beba-0554eeb455bb', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd501e9-f49e-44a3-bd9a-fc9e3d7ec1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:26 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Volume volume-c64ea55c-efa4-4213-beba-0554eeb455bb (c64ea55c-efa4-4213-beba-0554eeb455bb): created successfully
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bd501e9-f49e-44a3-bd9a-fc9e3d7ec1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:26 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Flow 'volume_create_manager' (a8ba6679-8f5c-4701-8ac3-2973452322c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:26 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-1c54ca88-4074-48fd-98fa-d210a187a260 tempest-ProjectReaderTests-575787549 None] Created volume successfully.
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Acquiring lock "cinder-c64ea55c-efa4-4213-beba-0554eeb455bb-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Lock "cinder-c64ea55c-efa4-4213-beba-0554eeb455bb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Acquiring lock "cinder-quobyte-c64ea55c-efa4-4213-beba-0554eeb455bb" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Lock "cinder-quobyte-c64ea55c-efa4-4213-beba-0554eeb455bb" acquired by "delete_volume" :: waited 0.014s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40326af-f958-4fc0-bc4b-ebed612daf8f]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:27 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb
Nov 05 18:55:27 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:27 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb" returned: 0 in 0.347s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:27 devstack sudo[108434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb
Nov 05 18:55:27 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:27 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-c64ea55c-efa4-4213-beba-0554eeb455bb" returned: 0 in 0.230s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Lock "cinder-quobyte-c64ea55c-efa4-4213-beba-0554eeb455bb" released by "delete_volume" :: held 0.623s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Created reservations ['2cac31ad-2987-4b8e-bc13-0b9f175fcd54', '0c21fc8f-ae5e-4736-9d29-7c3cacfe4683', '2fd6e040-df9c-4a89-8426-7307832f3217', 'c330025d-5b03-45d2-9779-8c8581927ef9'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:27 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:28 devstack sudo[108437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:55:28 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:28 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.241s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:55:28 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Deleted volume successfully.
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-61a5984e-41b8-40e9-ac75-f6b02b02a877 tempest-ProjectReaderTests-575787549 None] Lock "cinder-c64ea55c-efa4-4213-beba-0554eeb455bb-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.flows.manager.create_volume [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87086) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Flow 'volume_create_manager' (f3f0ddd2-d976-4c1a-a820-dfb81e218ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e6f641-fb0f-4227-82b0-6d95612bf4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e6f641-fb0f-4227-82b0-6d95612bf4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135869063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19442784-8c81-4d28-9540-a10e6063cc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af4383f562c4220bb84cb153c78d9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:29Z,use_quota=True,user_id='a2328eb64ccf4bb7a78a3d4cbff55ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6475cd9d-117c-4f8c-899f-9b5bf28a1781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6475cd9d-117c-4f8c-899f-9b5bf28a1781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d40e1e9-17d9-4275-9868-fc9219a41aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d40e1e9-17d9-4275-9868-fc9219a41aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19442784-8c81-4d28-9540-a10e6063cc45', 'volume_name': 'volume-19442784-8c81-4d28-9540-a10e6063cc45', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83332a0d-acf4-44f3-8a5e-af6cc89acb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83332a0d-acf4-44f3-8a5e-af6cc89acb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1aa320c-8ef3-40d1-a2ef-42bfb5471779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:28 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Volume 19442784-8c81-4d28-9540-a10e6063cc45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19442784-8c81-4d28-9540-a10e6063cc45', 'volume_size': 1}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bcf5107c80>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T17:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135869063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19442784-8c81-4d28-9540-a10e6063cc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af4383f562c4220bb84cb153c78d9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T17:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T17:55:29Z,use_quota=True,user_id='a2328eb64ccf4bb7a78a3d4cbff55ad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f63d6eb9-4af2-49eb-859f-75226f7b24ad),volume_type_id=f63d6eb9-4af2-49eb-859f-75226f7b24ad)}" {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.remotefs [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Creating volume 19442784-8c81-4d28-9540-a10e6063cc45 {{(pid=87086) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Selected osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023 as target Quobyte volume. {{(pid=87086) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 18:55:28 devstack cinder-volume[87086]: INFO cinder.volume.drivers.remotefs [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] casted to osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023
Nov 05 18:55:28 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45 1073741824 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:28 devstack sudo[108440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45 1073741824
Nov 05 18:55:28 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:29 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45 1073741824" returned: 0 in 0.404s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:29 devstack sudo[108446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45
Nov 05 18:55:29 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:29 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45" returned: 0 in 0.232s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'} {{(pid=87086) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1aa320c-8ef3-40d1-a2ef-42bfb5471779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19442784-8c81-4d28-9540-a10e6063cc45', 'volume_size': 1}' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3ce21b-d021-499c-a735-343ece77613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 18:55:29 devstack cinder-volume[87086]: INFO cinder.volume.flows.manager.create_volume [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Volume volume-19442784-8c81-4d28-9540-a10e6063cc45 (19442784-8c81-4d28-9540-a10e6063cc45): created successfully
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3ce21b-d021-499c-a735-343ece77613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87086) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Flow 'volume_create_manager' (f3f0ddd2-d976-4c1a-a820-dfb81e218ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87086) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 18:55:29 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-5649a883-9032-4c4c-a57a-6b439954e6b2 tempest-ProjectReaderTests-575787549 None] Created volume successfully.
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Acquiring lock "cinder-19442784-8c81-4d28-9540-a10e6063cc45-delete_volume" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Lock "cinder-19442784-8c81-4d28-9540-a10e6063cc45-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Acquiring lock "cinder-quobyte-19442784-8c81-4d28-9540-a10e6063cc45" by "delete_volume" {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Lock "cinder-quobyte-19442784-8c81-4d28-9540-a10e6063cc45" acquired by "delete_volume" :: waited 0.016s {{(pid=87086) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdbfad3-3f3f-446c-a10d-17b2ce179688]: (4, 'qcow2') {{(pid=88401) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 18:55:29 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:30 devstack sudo[108449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45
Nov 05 18:55:30 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:30 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45" returned: 0 in 0.360s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:30 devstack sudo[108454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45
Nov 05 18:55:30 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:30 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751/volume-19442784-8c81-4d28-9540-a10e6063cc45" returned: 0 in 0.247s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Lock "cinder-quobyte-19442784-8c81-4d28-9540-a10e6063cc45" released by "delete_volume" :: held 0.654s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG cinder.quota [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Created reservations ['31dde3bd-1be5-459a-8b63-6d8f337f6253', '58a43b21-8c12-419a-9327-0d849cd753e1', '76a99084-9b94-4df1-ad63-580820444aae', '4962bb5a-6c93-488f-9f40-5218045eed3e'] {{(pid=87086) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023': None} {{(pid=87086) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG cinder.volume.drivers.quobyte [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4c30b540-5273-4ea6-bfa4-c88691be6023'] {{(pid=87086) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.lockutils [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87086) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751 {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 18:55:30 devstack sudo[108457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751
Nov 05 18:55:30 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 18:55:30 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG oslo_concurrency.processutils [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ca42233242448a6adf3f15fc40280751" returned: 0 in 0.232s {{(pid=87086) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG cinder.manager [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Notifying Schedulers of capabilities ... {{(pid=87086) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 18:55:30 devstack cinder-volume[87086]: INFO cinder.volume.manager [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Deleted volume successfully.
Nov 05 18:55:30 devstack cinder-volume[87086]: DEBUG cinder.coordination [None req-2709872d-f742-41a9-91be-6ee0ba9a2247 tempest-ProjectReaderTests-575787549 None] Lock "cinder-19442784-8c81-4d28-9540-a10e6063cc45-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87086) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 18:55:40 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=42,cinder:UPDATE=67,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 18:55:40 devstack cinder-volume[87086]: DEBUG dbcounter [-] [87086] Writing DB stats cinder:SELECT=41,cinder:UPDATE=64,cinder:INSERT=13,cinder:DELETE=7 {{(pid=87086) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}